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FOREWORD 


A  primary  mission  of  the  Leadership  and  Motivation  Technical 
Area  of  the  U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences  (ARI)  is  to  enhance  small  unit  readiness  and  per¬ 
formance  by  improving  leadership,  cohesion,  and  motivation.  The 
specific  research  described  in  this  report  is  part  of  a  larger 
project  on  how  leadership,  cohesion,  and  motivation  are  developed 
at  a  unit's  home  station  and  how  these  factors  affect  unit  effec¬ 
tiveness  as  indicated  by  performance  at  the  Army  Combat  Training 
Centers  (CTCs) .  The  larger  research  project  has  been  given  the 
task  title,  " Determinants  of  Small  Unit  Performance." 

This  research  report  describes  results  on  leadership  perfor¬ 
mance  and  its  measurement  in  exercises  at  one  of  the  Army  CTCs, 
the  National  Training  Center  (NTC) .  The  leadership  performance 
of  platoon  leaders  and  platoon  sergeants  was  measured  in  terms  of 
leadership  tasks  that  the  Center  for  Army  Leadership,  the  Army 
proponent  for  leadership  doctrine,  proposed  as  a  framework  for 
guiding  the  Army  leader  development  system.  Leadership  perfor¬ 
mance  was  measured  in  three  rotations  at  the  NTC  and  then  related 
to  other  ratings  of  overall  leadership  effectiveness  and  to  judg¬ 
ments  of  a  platoon's  effectiveness  in  accomplishing  its  missions. 
As  part  of  the  larger  project,  home  station  leadership  is  also 
being  measured  in  terms  of  these  leadership  tasks  to  provide  a 
wider  perspective  on  the  relationships  between  home  station 
leadership  and  leader  and  unit  effectiveness  as  indicated  by 
performance  at  a  CTC. 

The  Center  for  Army  Leadership  (CAL),  U.S.  Command  and 
General  Staff  College,  Fort  Leavenworth,  Kansas,  sponsored  and 
actively  participated  in  planning  the  research  reported  here. 

CAL  reviewed  early  results,  participated  with  ARI  in  briefing 
those  results  to  obtain  continued  support  for  data  collection, 
and  assisted  in  data  collection.  CAL  reviewed  the  final  version 
of  this  report  (January  1991)  and  requested  its  publication. 
Research  is  being  conducted  under  a  Memorandum  of  Agreement  be¬ 
tween  the  U.S.  Command  and  General  Staff  College  and  the  U.S. 

Army  Research  Institute,  dated  15  November  1990,  subject,  "Pro¬ 
gram  of  Research  in  Support  of  the  center  for  Army  Leadership." 


EDGAR  M.  JOHNSON 
Technical  Director 
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LEADERSHIP  PERFORMANCE  MEASUREMENT  IN  A  TACTICAL  ENVIRONMENT 


EXECUTIVE  SUMMARY. 


Requirement : 

The  Center  for  Army  Leadership  (CAL),  the  U.S.  Army's  pro- 
ponent  for  leadership  doctrine,  has  begun  to  focus  the  Army's 
leader  development  system  by  identifying  the  leadership  perfor¬ 
mances  critical  to  unit  warfighting  effectiveness.  This  initia¬ 
tive  requires  standardized  measures  of  leadership  in  terms  of 
potentially  critical  leadership  performances  and,  in  addition, 
information  for  defining  the  relative  importance  of  those  per¬ 
formances  to  unit  effectiveness. 


Procedure: 

A  method  for  measuring  the  leadership  performance  of  platoon 
leaders  and  platoon  sergeants  in  tactical  training  exercises  was 
developed.  The  method  operationalized  leadership  performance  in 
terms  of  a  test  framework  of  leadership  tasks  and  standards  pro¬ 
posed  by  CAL.  This  method,  applied  in  three  rotations  at  the 
National  Training  Center  (NTC) ,  called  for  judgments  by  the  NTC 
platoon  observer-controllers  (OCs)  of  leadership  task  perfor¬ 
mances  during  separate  exercises  (mission-level  judgments)  and 
for  the  rotation  as  a  whole  (summary  judgments) .  To  assess  the 
quality  of  the  measurement  of  performance,  platoon  and  company 
OCs  also  made  judgments  of  the  overall  leadership  effectiveness 
of  platoon  leaders  and  platoon  sergeants  and  of  the  effectiveness 
of  a  platoon  as  a  unit  in  accomplishing  its  mission (s). 


Findings: 

(1)  The  measurement  method  produced  judgments  of  the  sepa¬ 
rate  leadership  tasks  for  a  leader  (platoon  leader  or  platoon 
sergeant)  that  were  interdependent  with  platoon/unit  effective¬ 
ness,  performance  of  different  tasks  by  the  same  leader,  and 
performance  of  the  same  task  by  the  two  different  leaders. 

(2)  CAL's  framework  defines  leadership  tasks  that  appear  to 
be  a  meaningful  basis  for  measuring  leadership  processes  in  a 
unit  and  the  relationship  of  these  processes  to  unit  performance 
in  realistic  tactical  simulations.  Aggregated  measures  of  these 
tasks  for  a  leader  are  also  meaningfully  associated  with  the 
overall  leadership  effectiveness  of  the  leader. 
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(3)  The  measurement  method  did  not  distinguish  differences 
between  the  tasks  and,  therefore,  differences  in  their  relative 
importance  to  leadership  or  unit  effectiveness.  For  OCS  and  unit 
members,  there  is  nevertheless  some  consistency  in  their  views  of 
the  leadership  tasks  that  are  most  important  for  unit  effective¬ 
ness  in  combat  settings,  especially  the  tasks  important  for  pla¬ 
toon  leaders. 

(4}  The  present  leadership  performance  measurement  method 
needs  to  be  improved  to  yield  measures  of  leadership  that  are 
more  independent  of  the  organizational  leadership  processes  in 
the  performance  setting  and  that  are  more  independent  across  the 
separate  components  of  leadership.  This  may  require  a  more  elab¬ 
orate  framework  of  leadership  that  specifies  the  performance  at¬ 
tributes  that  distinctively  differentiate  both  the  separate 
leadership  components  and  the  leadership  behaviors  expected  of 
different  types  of  leaders. 


Utilization  of  Findings! 

These  data  provide  general  support  for  organizing  leader 
development  programs  around  the  leadership  components  in  CAL's 
framework  of  leadership  tasks.  They  also  identify  needs  for 
refinement  that  will  make  the  framework  and  measures  of  the 
performances  in  it  more  useful  for  standardized  assessment  of 
individual  leaders. 
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LEADERSHIP  PERFORMANCE  MEASUREMENT  IN  A  TACTICAL  ENVIRONMENT 


INTRODUCTION 


The  U.  S.  Army  Training  and  Doctrine  Command  (TRADOC)  formed 
a  special  study  group  in  1987  to  assess  the  current  status  of 
leader  development  activities  in  the  Army  and  to  identify 
immediate  and  long-term  actions  needed  to  direct  the  leader 
development  system  over  the  next  15  years.  This  1987  Leader 
Development  study  (LDS)  called  for  establishment  of  a  common 
doctrine  of  leadership  focusing  on  warfighting  and  specifying  the 
leadership  performances  required  for  warfighting  effectiveness. 
Once  established,  these  leadership  standards  would  be  used  to 
judge  the  success  of  and  to  indicate  improvements  in  components 
of  the  leader  development  system — leadership  selection,  training, 
assessment,  developmental  experiences  during  unit  assignments, 
etc.  The  standards  could  also  be  used  to  identify  needed  areas 
of  improvement  for  individual  leaders. 

The  C  iter  for  Army  Leadership  (CAL),  the  U.  S.  Army 
proponent  fc..  leadership  doctrino,  began  a  program  to  define  the 
leadership  standards  recommended  by  the  LDS.  The  overall  goal 
was  to  establish  a  data  base  for  identifying  and  validating  the 
leadership  tasks  and  performance  standards  that  are  required  for 
warfighting  effectiveness  and  that  are  generally  applicable  to 
the  Army's  leaders.  Toward  this  goal,  CAL  proposed  for  testing  a 
framework  of  leadership  tasks  and  standards.  Of  the  19 
originally  proposed  tasks,  nine  were  based  on  behavioral 
components  that  earlier  efforts  had  treated  as  leadership 
competencies  (Clement  &  Ayres,  1976;  Headquarters,  U.  S.  Army 
Training  and  Doctrine  Command,  1983) planning,  communication, 
supervision,  soldier/team  development,  decision  making, 
teaching/counseling,  professional  ethics,  technical/tactical 
proficiency,  and  management  technology.  These  nine  tasks  were 
augmented  by  tasks  describing  leadership  attributes  that  are 
reflected  in  (or  necessary  to  implement)  current  operational 
doctrine:  initiative,  flexibility,  motivation  of  others,  trust 
in  subordinates,  boldness,  climate  setting,  direction, 
innovation,  purpose,  and  risk  taking.  CAL  further  specified 
performance  standards  for  each  task  that,  as  presented,  tended  to 
consist  of  subtasks  of  the  broader  tasks.  CAL's  framework  also 
included  types  of  performances,  referred  to  as  performance 
indicators,  that  could  be  assessed  to  determine  whether  standards 
had  been  met.  Figure  1  presents  the  task  of  planning  to 
exemplify  CAL's  proposed  framework.  CAL's  proposal  reflected 


’The  nine  competencies  now  also  appear  in  the  most  recent 
version  of  the  U.  S.  Army  Field  Manual  22-100,  Military 
Leadership  (Headquarters,  Department  of  the  Army,  1989). 
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Figure  1 

Example  of  CAL's  Leadership  Tasks.  Standards, _ and .Performance 
Indicators 


TASK:  Plan  Effectively 
STANDARD  1.  Organize. 

Performance  indicators: 

^Leader  effectively  sequences  and  times  events  using 
backward  planning. 

-Leader  establishes  priorities  for  accomplishing  tasks. 
-Leader  identifies  and  allocates  resources  to  accomplish  the 
mission. 

STANDARD  2.  Establish  courses  of  action  to  meet  goals  and 
objectives. 

Performance  Indicators: 

-Leader  is  able  to  describe  the  actions  necessary  to 
accomplish  specific  courses  of  action. 

-Leader  considers  METT-T. 

-Leader  considers  resources  available. 

STANDARD  3.  Plan  beyond  initial  operations. 

Performance  Indicators: 

-contingency  plans  are  developed. 

-Resources  are  allocated  with  continuous  operations  in  mind. 
-Flexibility  to  change  quickly  is  built  into  the  plan. 
-Leader's  plan  is  consistent  with  commander's  intent. 

STANDARD  4.  Establish  a  unit  of  purpose  for  the  unit. 

Performance  Indicators: 

-Leader  establishes  priorities  for  accomplishing  mission. 
-Subordinates  at  least  two  echelons  below  understand  the 
overall  mission. 

-Leader's  purpose  fits  within  superior's  purpose. 

-Leader  establishes  tough  achievable  goals  and  objectives. 

STANDARD  5.  Establish  goals  and  objectives. 

Performance  Indicators: 

-Subordinates  understand  the  unit  goals  and  objectives. 
-Leader's  goals  and  objectives  are  within  the  intent  of 
higher  goals  and  objectives. 

-Leader  determines  task  milestones. 

-Subordinates  understand  sequencing  and  timing  of  tasks. 
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the  goal  of  a  leadership  framework  that  was  explicit  enough  to 
provide  an  Army-wide  basis  for  leader  development  and  assessment. 


LEADERSHIP  PERFORMANCE  AND.  MEASUREMENT 
IN  TACTICAL  EXERCISES 


One  thrust  of  research  by  the  U.  S.  Army  Research  Institute 
(ARI)  has  had  the  objective  of  developing  measures  of  leadership 
performance.  To  support  CAL's  program,  this  research  adopted 
CAL's  doctrinal  concepts  as  the  basis  for  measurement  of 
leadership  in  tactical  training  exercises  at  the  National 
Training  Center  (NTC) .  Prior  research  indicated  the  potential 
for  measurement  in  such  realistic  simulations  of  combat  (Pence  & 
Endicott,  1985). 

The  NTC  Training  Environment 

As  the  original  Combat  Training  Center  (CTC)  developed  by 
the  Army,  the  NTC  is  widely  regarded  as  providing  unit  training 
through  highly  realistic  simulations  of  combat.  For  training 
sessions  (or  rotations)  at  the  NTC,  brigades  composed  of  two 
battalion  task  forces  deploy  to  the  NTC  and  engage  in  successive 
combat  operations  (missions)  for  a  continuous  period  of 
approximately  two  weeks.  During  this  period,  there  are  two 
general  types  of  missions:  force-on-force  (FOF)  and  live  fire 
(LF) .  The  FOF  missions  are  fought  against  a  resident  opposition 
force  (OPFOR.)  that  is  organized  and  fights  in  accordance  with 
Warsaw  Pact  doctrine.  The  Multiple  Integrated  Laser  Engagement 
System  (MILES) — a  technology  in  which  laser  bursts  are  fired  with 
blank  rounds  and  detected  by  receptors  on  targets — is  used  on 
individual  soldiers  and  direct  fire  weapons  systems  to  simulate 
and  record  firing  data  and  kills.  Field  artillery,  air,  and 
chemical  attacks  are  also  played  but  somewhat  more  notional ly 
through  the  actions  of  the  observers/controllers  (OCs)  assigned 
to  elements  of  the  task  forces.  In  LF  missions,  live  ammunition 
is  used,  and  the  OPFOR  is  represented  by  target-silhouettes 
which,  in  some  areas  of  the  training  range,  "advance"  toward  the 
U.  S.  units  undergoing  training. 

Critical  to  the  training  exercises  are  the  OCs  permanently 
assigned  to  the  NTC.  As  a  rule,  one  OC  is  assigned  to  each 
platoon  and  larger  element  for  the  duration  of  a  rotation.  The 
OCs  perform  many  duties  to  meet  the  goal  of  realistic,  effective, 
and  safe  unit  training.  One  major  duty  involves  observation  of 
the  assigned  unit  and  its  members.  The  OCs'  observations  are 
used  to  insure  the  accuracy  of  records  on  unit  performance. 

Their  observations  also  provide  the  basis  for  feedback  to  the 
unit  both  in  discussions  conducted  after  each  mission  and  in 
reviews  of  the  rotation  prepared  for  the  unit's  use  at  its  home 
station. 
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The  length,  realism,  and  size  of  exercises  make  the  NTC  an 
excellent  training  setting.  They  also  make  the  NTC  a  potentially 
valuable  setting  for  data  collection  on  leadership  performance 
and  other  phenomena  in  combat  settings.  This  potential  is 
recognized  in  that  while  training  is  the  primary  NTC  objective,  a 
secondary  objective  is  use  of  the  experiences  by  particular  units 
to  develop  lessons  learned  for  the  Army  at  large.  As  has  been 
indicated  elsewhere  (U.  S.  General  Accounting  Office,  1986), 
application  of  measures  based  on  doctrinal  standards  would  help 
to  realize  the  research  potential  of  the  NTC. 

Early  Leadership.  Research  at  the  NTC 

ARI  research  on  leadership  and  its  measurement  at  the  NTC 
began  with  interviews  of  NTC  veterans  and  observations  of  NTC 
training  to  determine  the  possibilities  of  and  requirements  for 
data  collection  (Pence  &  Endicott,  1985) .  These  efforts 
concluded  that  observations  made  by  OCs  have  great  potential  for 
use  as  data  for  research  on  leadership.  It  was  also  concluded 
that  given  the  other  requirements  on  OCs  and  the  demands  for 
meeting  these  requirements,  a  data  collection  design  should 
create  neither  any  interference  with  the  OCs'  training  role  nor 
any  increase  in  existing  time  demands  on  the  OCs.  Two  types  of 
data  collection  were  suggested  as  workable.  Workloads  and  the 
field  environment  would  possibly  permit  an  OC  to  record  small 
amounts  of  data  during  missions.  These  data  could  then  be 
augmented  by  more  extensive  data  obtained  through  surveys 
completed  at  the  end  of  the  entire  rotation. 

The  potential  for  leadership  data  collection  was  examined 
further  in  an  NTC  rotation  that  focused  on  platoon-level 
leadership  and  the  relationship  between  the  platoon  leader  (PL) 
and  platoon  sergeant  (PSG)  (Rachford,  Twohig,  &  Zimmerman,  1986) . 
In  this  rotation,  10  broad  leadership  dimensions  defined  the 
framework  for  measurement  of  the  performances  of  PLs  and  PSGs. 

Of  the  10  dimensions,  nine  were  included  in  CAL's  more  recent 
task  list:  planning,  communication,  supervision,  soldier/team 
development,  decision  making,  teaching/counseling,  technical/ 
tactical  proficiency,  professional  ethics,  and  initiative.  The 
tenth  dimension  was  subordinate  leader  development.  Subject- 
Matter-Experts  (SMEs) ,  trained  in  the  data  collection  methods, 
were  the  primary  data  collectors.  Each  SME  was  attached  to  a 
platoon  OC  for  several  FOF  missions  to  collect  four  types  of  data 
on  the  PL  and  PSG.  Two  types  of  data  were  collected  for  each 
mission:  (1)  the  frequency  that  the  PL  and  PSG  performed  90 

tasks  representing  the  10  leadership  dimensions  and  (2)  the 
quality  of  the  PL- PSG  interactions.  After  having  observed  a  PL 
and  PSG  for  at  least  three  missions,  an  SME  made  two  additional 
ratings:  (1)  the  overall  performance  effectiveness  of  the  PL  and 

PSG  on  each  dimension  and  (2)  the  quality  of  the  working 
relationship  between  the  PL  and  PSG.  At  the  end  of  the  rotation. 
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the  OC  for  a  platoon  also  made  summary  judgments  of  the  overall 
leadership  effectiveness  of  the  PL  and  PSG  and  of  the 
effectiveness  of  the  platoon  with  respect  to  mission 
accomplishment . 

The  1986  rotation  yielded  results  pertinent  to  leadership 
effectiveness  and  the  PL-PSG  relationship,  some  of  which  are 
discussed  later.  The  number  of  leaders  who  SMEs  could  observe 
and  judge,  however,  was  much  smaller  than  had  been  expected. 

This  reduced  quantity  of  data  gave  support  to  the  earlier 
conclusion  that  observation  by  OCs  is  possibly  the  most  efficient 
means  for  collecting  leadership  data  in  NTC  exercises. 


ARI's  more  recent  research  at  the  NTC  has  had  two  principal 
objectives.  The  more  immediate  objective  was  to  assess  measures 
of  leadership  performance  developed  to  represent  CAL's  leadership 
framework.  The  second,  longer  term  objective  was  to  initiate  a 
data  base  on  leadership  and  unit  performance  for  further 
specification  of  the  leadership  components  for  inclusion  in  an 
Army-wide  framework  of  leadership. 

To  build  on  the  earlier  efforts,  this  research  has  focused 
on  platoon-levei  leadership.  The  measurement  method  was  also 
based  on  the  earlier  recommendation  (Pence  &  Endicott,  1985)  for 
data  collection  by  the  NTC  OCs.  More  specifically,  the  method 
called  for  collection  of  two  types  of  performance  judgments  by 
OCs,  one  consisted  of  judgments  of  the  performance  of  selected 
leadership  tasks  during  the  separate  missions  of  an  NTC  rotation. 
These  were  made  during  or  as  soon  as  possible  after  completion  of 
a  mission.  The  second  consisted  of  judgments,  made  at  the  end  of 
rotation,  of  performance  during  the  rotation  as  a  whole.  Overlap 
between  the  performances  judged  per  mission  and  for  the  rotation 
as  whole  allowed  assessment  of  measurement  reliability.  Other 
data  were  also  collected  in  order  to  assess  the  measures  of 
leadership  performance. 

Adoption  of  CAL's  leadership  framework  has  been  useful  for 
measurement  assessment.  That  is,  this  framework  is  essentially  a 
doctrinally  based  model  of  the  leadership  performances  important 
to  unit  effectiveness.  As  such,  it  sets  forth  at  least  two  basic 
sets  of  assumptions  for  assessment.  First,  it  suggests 
conditions  necessary  for  potential  measurement  settings — in  this 
case,  exercises  at  the  NTC.  In  particular,  CAL's  framework 
suggests  that  exercises  appropriate  for  leadership  measurement 
should  simulate  (or  otherwise  unfold)  events  in  which  leadership 
is  an  important  factor.  Even  more,  the  exercises  should  elicit 
performances  that  represent  CAL's  tasks.  Second,  CAL's  framework 
implies  that  effective  leadership  involves  performance  of  the 
identified  tasks  and,  moreover,  that  the  quality  of  task 
performance  impacts  positively  on  unit  effectiveness.  Results 


pertinent  to  the  latter  expectations  are  thus  indicative  of  the 
validity  of  the  leadership  performance  measures. 

Data  have  been  collected  during  three  NTC  rotations.  The 
core  measure  of  leadership  performance  was  the  same  in  all  three 
rotations.  The  methods  were  modified  after  the  first  rotation  to 
increase  the  data  available  for  measurement  assessment. 

REPORT  OBJECTIVES 

This  report  describes  the  method  developed  for  measuring 
leadership  performance  and  results  from  the  three  NTC  rotations 
in  which  the  method  was  used.  The  principal  objectives  are  to: 

(1)  assess  the  measures  developed  under  CAL's  framework  and  the 
general  potential  for  measurement  of  leader  performance  in  NTC 
exercises  and  (2)  describe  leadership  performance  during  the 
rotations  and  its  relationship  with  unit  effectiveness. 

RESEARCH  METHODS 

In  all  three  rotations,  platoon-level  OCs  applied  the  same 
method  to  (1)  judge  the  leadership  performance  of  platoon  leaders 
(PLs)  and  platoon  sergeants  (PSGs)  during  separate  missions  and 

(2)  make  summary  judgments  of  their  performance  for  the  rotation 
as  a  whole.  Platoon  OCs  also  made  judgments  for  assessing 
measurement.  In  all  rotations,  they  judged  the  overall 
leadership  effectiveness  of  the  PL  and  PSG  per  mission  and 
platoon  (unit)  effectiveness  both  per  mission  and  for  the  overall 
rotation.  In  the  second  and  third  rotations,  the  data  collected 
on  measurement  reliability  and  validity  were  expanded.  In  those 
rotations,  platoon  OCs  judged  leadership  effectiveness  for  the 
overall  rotation,  and  company-level  OCs  judged  the  effectiveness 
of  the  platoons  and  PLs  in  their  companies. 

LEADERSHIP-, JWORMAHCE  MEASURE 

The  measurement  method  was  designed  to  balance  two  somewhat 
competing  priorities,  one  was  a  method  complete  enough  to 
measure  CAL's  overall  framework  and  to  standardize  the  processes 
of  performance  observation  and  assessment.  The  second  was  to 
minimize  the  impact  of  the  mechanics  of  measurement  on  the  other 
duties  of  or  time  spent  by  OCs.  The  resulting  methodological 
approach  had  two  basic  components:  (1)  observation  guides  or 


2  Company  0C  judgments  were  collected  to  assess  reliability. 
It  is  recognized  that  their  judgments  were  not  ideal  for  this 
purpose.  Platoon  and  company  OCs  have  somewhat  different 
observational  bases  which  would  reduce  agreement.  On  the  other 
hand,  job  duties  require  them  to  trade  appraisals  (for  example, 
in  preparation  for  after-action-reviews)  which  would  have  reduced 
the  independence  of  their  judgments. 
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Instruments  which  OCs  used  to  make  scaled  judgments  of  leadership 
and  (2)  training  in  use  of  the  guides. 

Development  of  Observation  Instruments 

Leadership  tasks  selected  for  measurement.— Design  of  the 
observation  instruments  started  with  selection  of  the  leadership 
tasks  for  measurement.  CAL's  framework,  discussions  with  NTC 
OCs,  and  consideration  of  the  earlier  NTC  leadership  research 
indicated  the  following,  as  summarized  in  historical  order  in 
Table  1: 

(1)  The  nine  tasks  (see  first  column),  originally 
identified  as  leadership  competencies  (Headquarters,  U.  S. 
Training  and  Doctrine  Command,  1983),  were  derived  from  an 
extensive  literature  review  (Clement  6  Ayres,  1976) *  As  noted 
earlier,  these  nine  have  since  been  adopted  for  the  updated 
version  of  the  Army's  core  leadership  manual  (FM  22-100). 

(2)  ARl's  past  NTC  leadership  research  (second  column) 
had  covered  the  original  nine  performance  domains,  with  the 
exception  of  management  technology.  That  research  included  two 
additional  components— initiative  and  subordinate  leader 
development— that  were  more  directly  identifiable  in  CAL's  tasks 
representing  leadership  attributes. 

(3)  The  version  of  CAL's  framework  at  the  initiation  of 
this  effort  (third  column)  included  some  tasks  that,  even  though 
conceptually  distinguishable  from  each  other,  seemed  to  be  highly 
interrelated  (column  CAL  *87).  The  tasks  also  varied  in  the 
scope  and  likely  availability  of  observational  evidence  for 
judgments  about  whether  and  how  well  the  tasks  had  been 
performed.  These  qualities  were  later  used  to  select  and  reduce 
the  set  of  leadership  components  for  measurement. 

(4)  Discussions  with  NTC  OCs  (fourth  column)  revealed  that 
at  least  five  of  CAL's  leadership  tasks  were  believed  to  be 
consistently  observable  or  important  in  NTC  exercises:  planning, 
communication,  supervision,  initiative,  and  technical/tacticul 
proficiency. 

Given  these  considerations,  it  was  decided  that  leadership 
would  be  measured  in  terms  of  11  tasks  in  CAL's  framework  (see 
column  labeled  "NTC  '88  -  SUM").  Nine  of  these  tasks  were 
measured  on  all  three  rotations,  indicated  by  "Xs"  in  the  calls 
of  column  SUM.  These  included  the  five  identified  in  discussions 
with  the  NTC  OCs:  planning,  communication,  supervision, 
initiative,  and  technical/tactical  proficiency.  Those  five  tasks 
were  augmented  by  another  three  for  comparability  with  the 
earlier  AR1  research:  soldier/team  development,  decision  making, 
and  teaohing/counseling. 
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Table  1 

Leadership  Components  Identified  In  U.  S.  Army  Doctrinal  and 
Research  Efforts 


Doctrinal  and  Research  Efforts 


Leadership 

S.ampg.nfin& 


PAH  NTC  CAL  OC  NTC  *88 _ 

525-28  !££  122  131  MiflfliflD  SUM 


Planning  . 

Communication  . 

Supervision . . . . . . 

Soldier/Team 

Development  . 

Decision  Making  . 

Teaching/Counseling  . . . 
Technical/Tactical  . . . . 
Professional  Ethics  . . . 
Management  Technology  . 

Initiative  . . . . 

Flexibility  . 

Motivation  of  Others  . . 
Trust  in  Subordinates  . 

Boldness  . 

Innovation  . 

Climate  . 

Direction  . 

Purpose  , . 

Risk  Taking  . 

Subordinate  Leader 

Development  . 


X 

X 

X 

X 

X 

X 

X 

X 

X 


XXX 

XXX 

XXX 

X  X 

X  X 

X  X 

XXX 
X  X 

X 

XXX 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 


X  X 

X  X 

X  X 


X 

X 

X 


X 


X 

X 

Y 

Y 

z 

z 


Note.  Descriptions  of  column  headings  are  as  follows:  (1)  PAM 
525-28 — TRADOC  Pamphlet,  1983;  (2)  NTC  *86 — Components  identified 
for  earlier  ARI  research  (Rachford  et  al.,  1986);  (3)  CAL  ' 87 — 
Tasks  in  CAL's  initial  leader  performance  framework;  (4)  OC  '87 — 
Components  identified  in  interviews  with  OCs;  (5)  NTC  '88 — Tasks 
judged  per  mission  (Mission)  and  at  end  of  rotation  (SUM)  in  this 
effort.  Column  entries  are:  X  “  rated  in  all  3  rotations;  X  “ 
rated  in  first  rotation  only;  Z.  "  rated  in  second  and  third 
rotations  only. 
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The  other  task  measured  on  all  three  rotations  was 
flexibility.  The  latter  task  and  the  three  tasks  measured  on 
just  one  or  two  of  the  rotations  (motivation  of  others,  trust  in 
subordinates,  and  boldness)  had  been  chosen  by  CAL  to  represent 
leadership  attributes  necessary  for  battlefield  success.  These 
latter  four  tasks  seemed  to  be  distinct  from  the  existing 
competency-based  tasks.  They  were  varied  by  rotation  to  minimize 
the  number  of  tasks  judged  during  a  single  rotation  and  yet  to 
obtain  some  Information  on  most  of  the  tasks  proposed  for  the 
leadership  framework. 

To  distribute  measurement  demands  further,  it  was  decided  to 
measure  leadership  performance  during  the  separate  missions  in 
terms  of  five  of  the  selected  tasks  (see  column  labeled  "NTC  '88 
-  Mission") .  Four  of  the  five  tasks- -planning,  communication, 
supervision,  and  initiative— had  been  identified  by  OCs  as 
consistently  important  and/or  observable  at  the  platoon  level. 

The  fifth  task  judged  per  mission,  soldier/team  development,  was 
selected  to  insure  coverage  of  the  human  relations  aspeot  of 
leadership  during  missions.9  At  the  end  of  the  rotation, 
performance  of  these  five  tasks  and  of  the  other  tasks  selected 
was  measured  for  the  rotation  as  a  whole  (column,  NTC  '88  -  SUM). 

Performance  measurement  scale.— As  presented  earlier,  CAL's 
goal  has  been  a  leadership  framework  that  provides  a  standard  for 
assessing  leader  development.  CAL  leadership  experts  were 
presented  with  several  possible  scales  for  rating  leader 
performance.  Congruent  with  the  above  goal,  they  chose  a  four 
category  scale  of  the  "extent  to  which  performance  had  met 
standard."  The  four  categories  or  levels  of  performance  relative 
to  standard  were:  "far  below"  standard,  "below"  standard,  "meets 
standard",  and  "exceeds"  standard. 

Final  instrument  format. — The  leadership  tasks  and  the  scale 
for  judging  leadership  performance  during  separate  NTC  missions 
were  printed  on  a  three-by-five  note  card  depicted  in  Figure  2. 

As  Figure  2  shows,  the  card  called  for  separate  judgments  of  the 
performance  of  the  PL  and  PSG  in  a  platoon  on  the  five  leadership 
tasks  identified  earlier.  For  each  task,  summary  descriptions  of 
more  explicit  performances  or  conditions  were  printed  as 
reminders  of  the  task  definitions.  The  performance  descriptions 
were  drawn  from  the  materials  prepared  to  train  OCs  in  use  of  the 
measurement  method. 


9  Consideration  of  the  materials  to  be  used  by  OCs  to  record 
judgments  led  to  the  decision  that  five  tasks  would  be  judged  per 
mission.  While  OCs  had  nominated  technical/tactical  proficiency 
and  while  this  leadership  component  is  obviously  important,  CAL's 
and  API's  research  programs  were  more  directly  concerned  with  the 
non-technical  aspects  of  a  leadership  performance. 
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Figure  2 

Measure  of  Leadership  Performance 


The  end-of-rotation  judgments  were  obtained  through  a 
questionnaire  which  replicated  the  task  description  format  and 
the  judgment  scale  used  per  mission.  However,  the  questionnaire 
presented  11  tasks  for  judgment.  Moreover,  a  summary  or  overall 
judgment  of  performance  was  sought  for  each  task  through 
instructions  indicating  that  these  judgments  were  to  be  "based  on 
the  rotation  as  a  whole"  for  the  observed  PL  and  PSG.  This 
questionnaire  appears  in  Appendix  A. 

Observer. Training 

As  noted  earlier,  CAL's  framework  described  leadership 
performance  in  increasingly  more  objective  or  explicit  terms  as 
it  shifted  from  description  of  a  task  to  specification  of 
performances  indicating  "performance  according  to  standard." 

The  observer  training  built  on  this  framework  and  sought  to 
achieve  consistency  in  performance  judgments  by  focusing 
attention  on  the  types  of  behavioral  or  objective  indicators 
identified  by  CAL.  The  training  and  training  materials  were 
developed  around  the  five  leadership  tasks  judged  per  mission. 

For  each  of  the  five  tasks,  CAL's  original  standards  and 
indicators  of  task  performance  were  first  synthesized  into 
descriptions  of  performances  that  represent  "meets  standard"  for 
the  task.  For  each  task,  behavioral  anchors  were  then  prepared 
for  the  other  levels  of  performance — far  below,  below,  and 
exceeds  standards.  These  anchors  were  also  drawn  from  CAL's 
standards  and  indicators  but  written  to  describe  relative, 
qualitative  differences  likely  associated  with  performance 
exceeding  standard  or  falling  at  some  level  below  standard.  To 
focus  judgment  further,  a  more  extensive  listing  of  performances 
indicators  for  each  task  was  generated;  however,  these  indicators 
were  not  differentiated  by  level  of  performance.  These 
descriptions  were  assembled  into  materials  for  reading  prior  to 
the  start  of  a  rotation.  Appendix  B  contains  these  materials. 

For  the  first  and  second  rotations,  classroom  training  was 
held  in  a  one-hour  session  for  each  OC  group,  a  day  or  two  before 
a  rotation.4  The  third  rotation  followed  closely  enough  behind 
the  second  rotation  that  training  sessions  were  not  conducted. 
Prior  to  a  session,  OCs  were  supplied  read-ahead  copies  of  the 
mission-level  data  collection  cards  and  copies  of  the  materials 
for  guiding  observation  and  judgment  of  leadership  task 
performance  during  the  missions.  The  training  session,  led  by  an 
ARI  researcher,  concentrated  on  reinforcing  the  read-ahead 
materials  by:  (1)  clarifying  the  goal  that  leadership 
performance  should  be  judged  according  to  the  standards  provided; 
(2)  discussing  the  standards  provided;  (3)  emphasizing  use  of 


4  A  one-hour  session  was  planned  to  fit  with  the  time 
available  for  training. 
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actual  performance  observations  as  the  basis  for  judgments;  and 
(4)  reviewing  expected  data  collection  procedures  with  respect  to 
the  leaders  targeted  for  observation  (PLs  and  PSGs) ,  Independence 
of  judgments  of  PL  and  PSG  leadership,  and  the  timing  and 
mechanics  of  recording  judgments  on  the  cards. 

APPLICATION  OF  THE  MEASUREMENT  METHOD 


Sample 

The  three  NTC  rotations  with  data  collection  occurred  during 
fiscal  year  1988.  The  brigades  undergoing  training  were 
organized  into  two  battalion  task  forces  (TFs) ,  with  each  TF 
composed  of  organic  companies  and  of  companies  cross-attached 
from  other  battalions,  usually  from  the  same  brigade.  All  TFs 
had  either  armor  or  heavy  infantry  line  companies.  In  each 
rotation,  one  TF  typically  fought  three  battalion-level  force-on- 
force  (FOF)  missions  followed  by  three  battalion-level  live  fire 
(LF)  missions.  The  order  of  the  FOF  and  LF  sets  was  reversed  for 
the  other  TF.  In  the  last  phase  of  the  rotation,  both  TFs 
undertook  another  three  FOF  missions  within  the  context  of 
brigade-level  operations.  The  types  of  missions  included  defense 
in  sector,  movement  to  contact,  hasty  attack,  and  deliberate 
attack.  Missions  began  both  in  daylight  and  darkness. 

For  each  mission,  data  were  collected  on  the  mechanized 
infantry,  armor,  scout,  mortar,  engineer,  and  field  artillery 
platoons  (or  comparable  levels)  in  each  TF.  Given  the  TF 
organizations,  the  maximum  potential  sample  was  33  platoons  per 
mission,  per  rotation. 

Data  Collectors 

The  OCs  assigned  to  the  sampled  platoons  were  the  principal 
data  collectors.  In  accordance  with  routine  NTC  procedures,  one 
OC  was  assigned  to  a  platoon  during  its  six  FOF  missions .  A 
different  OC  observed  the  platoon  during  its  three  LF  missions. 
Therefore,  all  judgments  of  FOF  performance  for  a  platoon  were 
made  by  a  single  OC;  likewise,  all  judgments  for  LF  performance 
were  made  by  a  single  but  different  OC.  In  the  second  and  third 
rotations,  company-level  OCs  performed  analogously  to  collect 
data  to  assess  measurement  reliability. 

To  collect  supplementary  data  on  leader  performance  and  its 
measurement,  a  subject-matter-expert  (SME)  accompanied  the  OCs 
(LF  and  FOF)  for  each  of  10  platoons  during  the  first  rotation. 

Of  the  10  SMEs,  three  were  ARI  researchers;  the  remainder 
consisted  of  five  commissioned  and  two  noncommissioned  officers 
from  various  training  centers  and  agencies  with  special  interest 
in  leadership.  The  SMEs  were  trained  in  a  four-hour  block  that 
included  the  training  given  OCs  and  additional  background 
information  tc  guide  collection  of  the  supplemental  data. 
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Instruments 


PC  mission-level  cards. — OCs  used  three  three-by-five  note 
cards  to  collect  data  on  each  separate  mission.  Figure  2, 
presented  earlier,  replicates  the  card  that  platoon  OCs  used  to 
record  judgments  of  leadership  performance.  The  card  as  it 
appears  in  Figur*9  2  was  the  same  for  all  three  rotations.6 

A  second  card  was  used  in  all  rotations  to  collect  data  for 
validating  the  mission-level  measures  of  leadership  performance. 
As  shown  in  Figure  3,  this  card  contained  items  that  elicited 
platoon  OCs'  judgments  of  the  overall  effectiveness  of  (1)  PLs 
and  PSGs  as  leaders  and  (2)  the  platoon  as  a  unit  in 
accomplishing  its  mission.  Leadership  and  platoon/unit 
effectiveness  were  judged  on  a  four-category  scale  ranging  from 
"poor"  to  "excellent.'1  The  items  on  PL  leadership  effectiveness 
and  platoon/unit  effectiveness  were  similarly  formatted  on  a  card 
to  obtain  company  OCs'  judgments  per  mission.  As  Figure  3  notes, 
the  other  items  on  this  card  differed  somewhat  for  the  first  and 
two  later  rotations.  In  all  rotations,  judgments  were  obtained 
about  the  importance  of  leadership  to  mission  accomplishment.  In 
the  first  rotation,  importance  of  "platoon-level"  leadership  was 
rated;  importance  ratings  were  made  separately  for  the  PL  and  PSG 
in  the  two  later  rotations.  In  the  first  rotation  only,  this 
card  produced  judgments  about  sleep  for  use  other  research  being 
supported  by  the  NTC. 

A  third  card  was  used  in  the  three  rotations  (see  Appendix 
C) .  In  the  first  rotation,  this  card  elicited  judgments  of  the 
quality  of  five  components  of  the  working  relationship  displayed 
by  a  PL  and  his  PSG  during  a  mission.  For  the  second  and  third 
rotations,  OCs  used  this  card  to  summarize  the  evidence  they  had 
used  for  judging  performance  of  the  leadership  tasks. 

PC  end-of-rotation  questionnaire. — 1 The  questionnaires 
administered  to  platoon  OCs  at  the  end  of  all  three  rotations 
(see  Appendix  A)  contained  the  items  that,  as  described  earlier, 
produced  summary  judgments  of  a  PL's  and  PSG's  performance  of  11 
leadership  tasks.  Items  were  also  included  for  judgments  of 
overall  unit  effectiveness  in  all  rotations.  In  the  second  and 
third  rotations,  the  questionnaire  included  items  for  judgments 
of  overall  leadership  effectiveness  of  the  PL  and  PSG.  All 


6  For  the  second  and  third  rotations,  space  was  identified 
on  the  back  of  this  card  for  OCs  to  make  notes  as  appropriate  of 
any  condition  that  had  limited  their  ability  to  make  sound 
judgments.  These  notes  provided  information  generally  comparable 
to  that  obtained  by  the  SMEs  in  the  first  rotation. 
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Figure  3 

Measures  of  Leadership  and  Platoon /Unit:  Performance 


overall  effectiveness  judgments  were  made  with  the  same  scale 
used  for  mission-level  judgments  (see  Figure  3) .  At  the  end  of 
the  two  later  rotations,  company  OCs  also  used  these  items  and 
scales  to  judge,  for  the  overall  rotation,  PL  leadership 
effectiveness. 

For  the  second  and  third  rotations,  the  platoon  OC 
questionnaire  contained  a  second  listing  of  the  11  leadership 
tasks  and  instructions  for  identifying  the  four  tasks  believed  to 
be  relatively  most  important  for  mission  accomplishment.  Each  OC 
nominated  the  most  important  leadership  tasks  separately  for  PLs 
and  for  PSGs. 

smb  guide. — For  the  first  rotation,  an  observation  guide  was 
prepared  that  contained  questions  and  statements  for  structuring 
observations  and  notes  by  SMEs  on  two  general  issues,  one  issue 
concerned  the  performances  observed  during  a  mission  or  other 
evidence  that  had  been  useful  to  the  SME  for  judging  performance 
of  the  11  leadership  tasks  by  the  PL  and  PSG.  The  second  issue 
concerned  conditions  in  the  unfolding  of  a  mission  that  placed 
constraints  on  the  leadership  performance  of  a  PL  or  PSG  or  that 
influenced  (either  positively  or  negatively)  observation  and 
judgment  of  such  performance.  Appendix  D  outlines  the  content  of 
the  SME  guide. 

Procedures 

Data  collection  during  missions.— The  platoon-  and  company- 
level  OCs  executed  their  routine  duties  for  the  missions  in  the 
rotation.  Per  the  OC  training,  the  OCs  recorded  their  mission 
specific  judgments  on  the  note  cards  as  soon  after  the  end  of  a 
mission  as  duty  requirements  allowed. 

After-Action  discussions. —At  the  ends  of  the  first  two 
rotations,  a  one-hour  discussion  was  held  with  the  teams  of  OCs 
who  had  judged  leadership  performance  during  missions.  In  each 
session,  OCs  first  completed  the  end-of-rotation  questionnaire. 
Afterward,  an  ARI  researcher  posed  questions  to  direct  group 
discussion  on:  (1)  ways  to  improve  judgments  of  leadership 
performance,  (2)  opportunities  during  the  missions  for  observing 
and  judging  the  leadership  of  both  the  PL  and  PSG,  (3)  overall 
confidence  in  judgments  about  level  of  leadership  performance 
relative  to  standard,  and  (4)  adequacy  of  the  five  leadership 
tasks  as  a  measure  or  indicator  of  leadership  performance  during 
a  mission.  The  discussions  were  directed  to  obtain  as  many 
different  views  from  OCs  on  these  issues  as  practical,  as  opposed 
to  consensus.  Other  researchers  noted  the  OCs'  comments. 
Discussion  sessions  were  not  held  for  the  third  rotation,  and 
end-of-rotation  questionnaires  were  distributed  to  the  teams  of 
OCs  prior  to  the  rotation  for  self-administration  afterward. 
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After  the  first  rotation,  the  SMEs  participated  in  a  five- 
hour  group  discussion  of  similar  issues.  These  discussions  were 
structured  so  that  the  SMEs  relayed  their  experiences  and 
opinions  about  the  11  leadership  tasks  with  respect  to:  (1) 
evidence  during  a  rotation  that  is  obtainable  and  useful  for 
judging  task  performance  and  (2)  conditions  in  a  rotation  that 
help  or  hinder  acquisition  of  evidence  about  task  performance. 


For  judgments  of  both  mission-level  and  overall  rotation 
performances,  the  applicable  judgment  categories  were  first 
scaled  with  values  ranging  from  1  to  4,  with  the  values  assigned 
so  that  higher  values  represent  more  favorable  judgments  of 
performance  of  a  variable.  For  example,  judgments  of  performance 
of  the  leadership  tasks  were  scaled  as  follows:  1  -  "far  below 
standard";  2  «  "below  standard";  3  »  "meets  standard";  4  - 
"exceeds  standard." 

Many  analyses  of  the  mission-level  data  were  conducted  on 
averages  of  the  judgments  made  for  the  separate  missions, 
referred  to  as  a  mission  average  (MA) .  To  retain  as  much  data  as 
possible,  decision  rules  were  established  for  retaining  data  and 
calculating  MAs  for  platoons  with  missing  data  on  some  missions. 
Data  were  retained  and  averaged  if:  (1)  for  FOF  data,  there  were 
data  for  at  least  four  of  the  six  missions  for  a  variable  such 
that  two  of  the  missions  occurred  within  the  first  three  FOF 
missions  and  the  other  two  occurred  within  the  last  three  FOF 
missions;  (2)  for  LF  missions,  there  were  data  for  any  two  of  the 
three  LF  missions.  These  rules  for  data  retention  were  applied 
separately  for  each  variable  for  which  an  OC  made  a  judgment 
(e.g.,  for  each  of  the  five  leader  performance  components). 

Of  the  MA  measures,  four  sets  are  key  to  this  report.  One 
was  the  leadership  performance  measure  based  on  platoon  OCs' 
judgments  of  the  five  leadership  tasks  measured  per  mission. 

This  measure,  labelled  MA-Perf,  was  computed  for  each  PL  (PL  MA- 
PERF)  and  PSG  (PSG  MA-PERF)  by  first  averaging  judgments  of 
performance  of  each  task  across  missions  and  then  averaging 
across  the  averages  obtained  for  the  tasks.  The  other  key  MA 
measures  were  the  judgments  of  overall  effectiveness  made  per 
mission  for  assessing  the  validity  of  the  performance  measures: 

PL  as  a  leader  (platoon  and  company  OCs) ,  PSG  as  a  leader 
(platoon  OCs) ,  and  platoon  as  a  unit  in  accomplishing  its  mission 
(platoon  OCs) .  These  judgments  were  averaged  across  missions  to 
form  mission-level  measures  of  PL  effectiveness  (PL  MA-EFF) ,  PSG 
effectiveness  (PSG  MA-EFF) ,  and  platoon  unit  effectiveness  (PLT 
MA-EFF) . 

The  platoon  OCs'  end-of-rotation  performance  judgments  were 
also  averaged  to  form  an  overall  or  summary  measure  of  leadership 
performance  for  each  PL  and  PSG.  These  measures,  referred  to  as 


PL  and  PSG  SUM-PERF,  were  formed  by  averaging  judgments  of  the 
nine  leadership  tasks  common  to  the  three  rotations.  The  end-of- 
rotation  measures  of  effectiveness  for  the  overall  rotation  did 
not  require  averaging:  effectiveness  of  a  platoon  in 
accomplishing  its  missions  (PLT  SUM-EFF)  and  the  second  and  third 
rotation  measures  of  overall  platoon  leader  and  platoon  sergeant 
effectiveness  (PL  SUM-EFF,  PSG  SUM-EFF) . 

RESULTS  AND  DISCUSSION 

This  report  presents  quantitative  results  on  OCs'  judgments 
of  performance  in  FOF  missions.  Several  considerations  drove  the 
decision  to  concentrate  on  FOF  data.  First,  the  LF  and  FOF 
missions  set  up  different  performance  contexts,  and  separate 
analysis  prevents  contextual  differences  from  masking  results. 
Second,  the  larger  number  of  FOF  than  LF  missions  (six  versus 
three)  provides  a  somewhat  more  reliable  basis  for  performance 
measurement  and  identification  of  relationships.  Finally, 
separate  analysis  allows  for  more  direct  comparison  of  present 
results  with  results  of  earlier  ARI  NTC  leadership  research 
(Rachford  et  al.,1986)  which  involved  only  FOF  missions. 

LEADERSHIP  PERFORMANCE  MEASUREMENT 
Potential  for  Measurement 

As  used  here,  measurement  potential  concerns  whether  a 
measurement  method  yields  the  types  of  data  of  interest  when  the 
method  is  applied  in  a  particular  performance  setting,  in  this 
case  the  NTC.  Platoon  OC  judgments  produced  data  on  three 
indicators  of  potential;  completeness  of  data  returns,  perceived 
importance  of  leadership  for  platoon  mission  accomplishment,  and 
sensitivity  of  the  leadership  measures  to  the  potential  range  of 
leadership  performance. 

Completeness  of  data. — A  basic  indicator  of  the  potential 
for  measurement  is  the  extent  to  which  data  expected  to  be 
available  for  collection  are  actually  collected.  The  more 
complete  the  data,  the  stronger  the  indication  that  the  variable 
or  its  measure  has  some  application  in  the  measurement  setting. 
For  this  effort,  this  indicator  was  examined  for  missiou-level 
variables  in  terms  of  the  proportion  of  missions  in  which  OCs 
made  judgments  about  the  five  leadership  tasks. 


For  the  FOF  missions,  there  were  about  540  opportunities  for 
missions-level  judgments  of  each  task  (3  rotations  by  30  platoon 
OCs  by  6  FOF  missions).  For  the  five  leadership  tasks,  the 
average  percents  of  judgments  for  a  task  were  92%  for  PLs  and  87% 
for  PSGs .  These  results  indicate  that  the  OCs  were  able  to  make 
judgments  of  leadership  performance.  The  somewhat  lower 
proportion  of  judgments  for  PSGs  could  indicate  the  difficulty  of 
observing  multiple  leaders.  This  relatively  lower  proportion 
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could  also  indicate  the  distribution  of  leadership  tasks  during 
missions.  That  is,  past  research  (Twohig  &  Tremble,  1987b)  found 
that  soldiers  believed  that  in  a  combat-type  setting,  PLs  were 
more  likely  to  perform  behaviors  representing  CAL's  leadership 
tasks  than  were  PSGs. 

Leadership  importance. — Since  the  NTC  simulates  battalion- 
and  brigade-level  combat  operations,  one  issue  for  measurement 
potential  is  whether  the  NTC  performance  context  exercises 
platoon-level  leadership  performance  so  that  it  is  an  appropriate 
target  for  measurement.  To  examine  this,  OCs  used  the  four-point 
scales  described  earlier  (see  Figure  3)  to  judge  for  each  mission 
the  importance  of  leadership  for  platoon  mission  accomplishment. 


For  the  first  rotation,  the  average  mission-average  (MA) 
rating  of  importance  of  platoon  leadership  was  3.1.  For  the  last 
two  rotations  with  separate  importance  ratings  for  PLs  and  PSGs 
(see  Table  E-2) ,  average  MA  values  were  2.9  and  2.8, 
respectively.  All  of  these  values  are  close  to  the  scale  point 
(that  is,  3)  signifying  '•important11 .  These  ratings  indicate 
beliefs  that  the  NTC  setting  creates  performance  conditions  in 
which  leadership  is  an  active  ingredient  and,  therefore,  that 
this  setting  is  potentially  suitable  for  measuring  leadership. 

There  were,  however,  some  missions  in  which  leadership  was 
rated  less  than  important.  OC  notes  indicated  that  this  was 
usually  due  to  mission  conditions,  such  as  a  unit's  being 
bypassed  in  a  defense  or  lack  of  vehicles  to  mount  a  meaningful 
offense.  One  implication  is  that  free-play  missions  are  not 
necessarily  equally  appropriate  for  research  and  measurement  of 
leadership. 

Sensitivity  to  range  of  leader  performance— Assuming  some 
range  in  leaders'  performance  abilities,  correspondence  between 
this  actual  range  and  the  range  of  the  measurement  scale  used, 
and  a  performance  context  eliciting  this  variation,  one  would 
expect  that  a  measurement  method  would  produce  values  that 
reflect  the  full  range  of  scale  values.  Measurement  potential 
from  this  point  of  view  was  examined  in  terms  of  the  variation  of 
values  across  leaders  and  across  missions. 

Table  2  describes  the  MA  values  for  these  judgments  and 
their  variation  across  PLs  and  PSGs.  Average  values  tended  to 
fall  at  or  just  below  the  scale  mid-point  of  2.5,  as  is 
desirable.  There  were  no  significant  differences  between  the 
values  for  PLs  and  PSGs.  standard  deviations  ranged  from  about 
.5  to  .6,  indicating  that  average  judgments  generally  ranged  from 
about  2.0  to  3.0  ("somewhat  below  standard"  to  "meets  standard"). 
The  obtained  range  of  values  shows  that  the  full  potential  range 
of  the  scales  tended  to  be  used. 
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Table  2 

Descriptive  Statistics  of  Mission-Average  Measures  of  Leadership 
Task  Performance 


Leader 

_ Platoon 

Xaata 

JL 

Std 

MAX/MIN 

JL 

Std 

MAX/MIN 

Planning 

2.3 

.5 

3. 5/1. 2 

2.2 

.5 

3. 0/1.2 

Communication 

2.5 

.5 

3. 8/1.0 

2.5 

.5 

3. 4/1. 3 

Supervision 

2.4 

.5 

3. 3/1.0 

2.4 

.5 

3. 8/1.0 

Initiative 

2.5 

.6 

3. 5/1.0 

2.4 

.6 

3. 5/1.0 

Soldier/Team 

Development 

2.6 

.6 

3. 7/1.0 

2.6 

.6 

4. 0/1. 2 

Nots .  Means/  standard  deviations,  and  obtained  ranges  of  MA-PERF 
measures.  Sample  sizes  of  79-81  for  platoon  leaders  and  71-76 
for  platoon  sergeants. 
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Corresponding  results  for  the  SUM  ratings  of  the  11 
leadership  tasks,  made  at  the  end  of  rotation,  are  shown  later 
(Tables  7  and  9).  The  pattern  of  results  is  similar  to  that  in 
Table  2,  with  mean  values  ranging  from  2.1  to  2.6  and  with 
standard  deviations  of  about  .8.  Again,  values  for  PLs  and  PSGs 
were  essentially  the  same. 

To  examine  variation  in  performance  across  missions,  the 
standard  deviation  of  values  for  a  task  across  the  EOF  missions 
was  calculated  for  each  leader.  The  average  of  these  standard 
deviations  values  was  then  computed  for  each  tasks.  The  average 
standard  deviations  ranged  from  about  .4  to  about  .6  for  the 
various  scales,  indicating  that  the  platoon  OCs  did  use  the 
instruments  to  record  differences  in  performance  from  mission  to 
mission. 

These  results  suggest  that  the  measurement  method  captured 
variation  in  leadership  performance  in  NTC  exercises.  Results  on 
reliability  and  validity,  presented  next,  indicate  the 
meaningfulness  of  this  variation. 

Measurement  Reliability  and  Validity. 

Table  3  summarizes  correlations  between  measures  of 
performance  and  effectiveness  based  on  platoon  OC  judgments. 

Table  4  presents  correlations  between  platoon  and  company  OC 
judgments  of  PL  leadership  effectiveness  and  platoon/unit 
effectiveness .  Table  3 1 s  correlations  between  MA-PERF  and  SUM- 
PERF  bear  on  the  test-retest  reliability  of  the  measures  of 
leadership  performance  since  they  are  averages  of  judgments  made 
at  the  time  of  performance  (MA-PERF)  and  summary  judgments  (SUM- 
PERF)  made  after  all  missions  had  been  completed.  The 
correlations  in  Table  4  baar  on  inter-rater  reliability;  however, 
they  are  correlations  between  measures  of  effectiveness  as 
opposed  to  measures  of  performance. 

The  evidence  on  measurement  reliability  was  mixed.  That  is, 
correlations  between  MA-PERF  and  SUM-PERF  were  statistically 
significant  and  strong  for  both  PLs  (.89)  and  PSGs  (.77).  The 
moderately  strong  and  significant  correlations  between  the 
platoon  and  company  OCs'  judgments  of  PL  leadership  effectiveness 
also  indicate  the  potential  for  reliable  measurement  given 
differences  in  the  duties  of  company  and  platoon  OCs  in  NTC 
exercises  and  the  resulting  differences  in  their  perspectives  and 
observational  opportunities.  However,  this  evidence  for 
reliability  was  weakened  by  the  moderate  to  high  correlations 
between  most  measures  in  Table  3.  This  pattern  of 
intercorrelation  suggests  that  the  correlations  were  due  to 
common  variance  or  a  halo  effect  in  the  measures  based  on  platoon 
OCs'  judgments.  Halo  is  especially  suspect  in  the  correlation  of 
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Table  3 


Correlations  between  Measures  of  Leadership  Performance  and  Measures  of  Leadership 
and  Unit  Effectiveness:  Platoon  PC  Judgments 


PL  PSG  P/U 


Platoon  Leader  (PL)  (1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

MA-PERF  (1) 

.89 

.83 

.75 

.85 

.66 

.60 

.44 

.61 

.63 

(69) 

(75) 

(46) 

(70) 

(69) 

(71) 

(46) 

(57) 

(70) 

SUM-PERF  (2) 

.84 

.75 

.70 

.67 

.49 

.40 

.59 

.74 

(70) 

(55) 

(63) 

(81) 

(66) 

(55) 

(51) 

(83) 

MA-EFF  (3) 

• 

.74 

.63 

.50 

.67 

.25 

.65 

.65 

(49) 

(67) 

(69) 

(74) 

(49) 

(57) 

(72) 

SUM-EFF  (4) 

. 

.42 

.41 

.40 

.36 

.51 

.61 

(42) 

(53) 

(56) 

(56) 

(30) 

(56) 

Platoon  Sergeant  (PSPl 

MA-PERF  (5) 

. 

.77 

.77 

.58 

.59 

.56 

(63) 

(67) 

(42) 

(52) 

(63) 

SUM-PERF  (6) 

.74 

.76 

.66 

.66 

(65) 

(53) 

(51) 

(81) 

MA-EFF  (7) 

• 

.59 

.59 

.42 

(47) 

(54) 

(68) 

SUM-EFF  (8) 

. 

.33 

.50 

(30) 

(56) 

Elatflon/Unit  (P/U) 

MA-EFF  (9) 

• 

.70 

(51) 

SUM-EFF  (JO) 

- 

Note:  Correlations  of  ,36  or 

greater  statistically  significant  (d  <  .051.  Sample  per  correlation  in  parentheses. 

Table  4 


Correlations_between  Elatoon  and  Company  PCs*  Judgments  of  leadership  (PL  &  PSG)  < 
IMLEffegtolfiSS 


Coaany  OC 


Platoon  QC 

PL  MA-EFF 

PL  SUM-EFF 

Platoon  Leader.  (PL) 

MA-EFF 

.46 

.30 

(39) 

(40) 

SUM-EFF 

.63 

.43 

(35) 

(43) 

Platoon  Sergeant  (PSG1 

MA-EFF 

.12 

.06 

(37) 

(38) 

SUM-EFF 

.20 

.17 

(35) 

(43) 

Platoon/Unit  (P/Ul 

MA-EFF 

.59 

.38 

(24) 

(26) 

SUM-EFF 

.50 

.49 

(35) 

(43) 

Note:  All  correlations  of  .38  or  greater  statistically  significant  (o  <  .051.  Correlation  of.30,  p^.,07  Sample  per 
correlation  in  parentheses. 
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.85  between  PL  and  PSG  MA-PERF.  Those  measures  were  averages  of 
20  to  30  judgments,  and  such  averaging  would  have  produced  scores 
reflecting  the  common  variance.  That  the  measures  captured  some 
differentiation,  however,  is  indicated  by  the  nonsignificant 
correlations  (Table  4)  between  company  OCs'  judgments  of  PL 
leadership  effectiveness  and  platoon  OCs'  judgments  of  PSG 
effectiveness. 

Results  on  measurement  validity  provide  some  further 
evidence  of  differentiation  and  also  suggest  a  possible  source  of 
the  halo.  Measures  of  leadership  performance  were  strongly 
correlated  with  measures  of  leadership  effectiveness  for  both  PLs 
(correlations  between  PERF  and  EFF  measures  ranging  from  .75  to 
.84)  and  PSGs  (correlations  ranging  from  .58  to  .77).  These 
correlations  are  compatible  with  the  premise  that  CAL's  framework 
identifies  the  leadership  tasks  necessary  for  warfighting 
effectiveness.  Moreover,  differentiation  was  obtained  in  that 
with  one  exception  (the  correlation  between  PS  MA-PERF  and  PSG 
SUM-EFF  compared  to  the  correlations  between  PS  MA-PERF  and  PL 
SUM-EFF) ,  correlations  between  performance  and  effectiveness  for 
the  same  leader  were  significantly  higher  than  correlations 
between  this  leader  and  the  comparable  measure  of  effectiveness 
of  the  other  leader.  This  pattern  was  also  obtained  in  the 
correlations  between  company  and  platoon  OCs  judgments  of 
effectiveness  (Table  4)  so  that  with  one  exception  (the 
correlation  of  the  company  OC  judgments  of  PL  SUM-EFF  with  the 
platoon  OC  judgments  of  PL  SUM-EFF  compared  to  the  correlation  of 
the  same  company  OC  judgments  with  the  platoon  OC  of  PSG  SUM- 
EFF)  ,  correlations  were  significantly  (p  £  .05,  one  tailed) 
greater  between  ratings  of  PL  EFF  by  the  two  sets  of  OCs  than 
between  the  company  OC  ratings  of  PL  EFF  and  the  platoon  OC 
ratings  of  PSG  EFF. 

The  strong  positive  correlations  between  PL  and  PSG 
performance  and  platoon  effectiveness— both  mission-level  (PLT 
MA-Eff)  and  overall  rotation  (PLT  SUM-Eff ) — seem  to  suggest 
further  the  construct  validity  of  the  performance  measures.  Like 
the  correlations  with  leadership  effectiveness,  the  leadership 
performance  and  unit  effectiveness  correlations  were  probably 
inflated  by  halo.  It  is  also  possible  that  perceptions  of  unit 
effectiveness  were  the  basic  source  of  the  halo. 

That  is,  Table  3  shows  that  judgments  of  PL  and  PSG 
leadership  performance  were  strongly  associated.  Table  5 
displays,  for  SUM-PERF  judgments,  the  correlfttigna  between  tasks 
for  each  leader  and  the  correlations  between  leaders  for  each  of 
the  nine  tasks  judged  in  all  rotations.  Table  6  displays  the 
same  correlations  based  on  MA  judgments.  Both  tables  indicate 
that  performance  of  the  same  task  bv  the  two  leaders  tended  to  be 
as  highly— if  not  more  highly— correlated  as  performance  of 
different  tasks  bv  the  same  leader.  This  suggests  that  an  aspect 
of  mission  performance  effectiveness  was  possibly  the  basic 
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Table  5 


Correlations  between  Leadership  Task  Performances  of  Platoon  Leaders  and  Platoon 
Sergeants;  Performance  for  the  Overall  Rotation 


Platoon  Leader  (PD 


Platoon  Sergeant  f?SQ) 

01 

01 

01 

01 

0) 

01 

01 

01 

01 

Planning  (1) 

*52 

.61 

.60 

.62 

.67 

.62 

.52 

.45 

.52 

Communication  (2) 

.61 

& 

.74 

.68 

.75 

.63 

.64 

.42 

.59 

Supervision  (3) 

.69 

M 

*52 

.65 

.68 

.63 

.77 

.46 

.59 

Initiative  (4) 

.56 

.63 

.70 

£Q 

.61 

.72 

.62 

.51 

.61 

Solider/Team  (5) 
Development 

.64 

.62 

.64 

.67 

.68 

.60 

.45 

.62 

Decision  Making  (6) 

.62 

.62 

.66 

.61 

.57 

& 

.64 

.45 

.67 

Teaching/Counseling  (7) 

.43 

.50 

.69 

.58 

.54 

.69 

*21 

.55 

.62 

Technical/Tactical  (8) 

.41 

.43 

.51 

.61 

.52 

.43 

.59 

& 

.55 

Flexibility  (9) 

.48 

.50 

.47 

.50 

.46 

.60 

.53 

.28 

^2 

Mote;  SUM  judgments  of  PL  and  PSG  performance  on  the  nine  tasks  common  to  all  rotations.  Top  half; 
Correlations  between  judgments  of  task  performance  by  PLs.  Diagonal;  Correlations  between  judgments 
of  PLs’  and  PSGs’  performance  of  the  same  task.  Bottom  half:  Correlations  between  judgments  of  task 
performance  by  PSGs.  Sample  per  correlation  ranged  from  82-85.  All  correlations  statistically  significant, 
E  <  .05. 


Table  6 

Correlations  between  Leadership  Task  Performances  of  Platoon 
Leaders  and  Platoon  Sergeants:  Performance  during  Missions 


Platoon  Leader 

(PL) 

Platoon..  Sergeant  (pss.). 

ill 

ill 

111 

ill 

131 

Planning  (1) 

*21 

.80 

.79 

.75 

.67 

Communication  (2) 

.78 

.78 

.74 

.74 

Supervision  (3) 

.75 

.75 

.78 

.74 

Initiative  (4) 

.74 

.77 

.83 

*31 

.75 

Soldier/Team  (5) 
Development 

.61 

.70 

.73 

.73 

*31 

Note.  Mission  average  judgments  of  PL  and  PSG  performance  on  the 
five  tasks  judged  per  mission.  Top  half:  Correlations  between 
judgments  of  task  performance  by  PLs.  Diagonal:  Correlations 
between  judgments  of  PLs*  and  PSGs'  performance  of  the  same  task. 
Bottom  half:  Correlations  between  judgments  of  task  performance 
by  PSGs.  Samples  par  correlation  ranged  from  71-81.  All 
correlations  statistically  significant  (p  £  .01). 


framework  for  judgment  of  individuals:  the  perceived  quality  of 
the  leadership  functions  or  processes  represented  by  the 
leadership  tasks.  Within  these  perceptions  of  rnit 
effectiveness,  PLs  and  PSGs  were  then  assessed  on  observations  of 
how  they  in  their  separate  roles  had  contributed  to  the  processes 
represented  by  the  tasks.  This  interpretation  accounts  for  the 
equally  strong  correlations  of  PL  and  PSG  leadership  performance 
with  unit  effectiveness  and  for  the  strong  intercorrelations 
between  their  performance  of  the  same  task:  perceptions  of  the 
processes,  themselves  as  elements  of  unit  effectiveness,  would 
have  driven  overall  judgments  of  the  separate  leaders.  It  would 
also  account  for  the  differentiation  obtained  in  correlations 
between  leadership  performance  judgments  and  judgments  of 
leadership  effectiveness:  PLs  and  PSGs  would  have  been  judged  on 
performances  reflecting  their  roles  in  the  leadership  prooesses 
and,  thus,  performances  relatively  more  specific  to  effectiveness 
of  their  own  roles. 

In  this  assessment  of  the  results,  the  measurement  methods 
did  not  elicit  judgments  of  leadership  performance  independent  of 
the  judgments  of  either  unit  effectiveness  or  the  organizational 
leadership  processes  represented  by  the  leadership  tasks. 

However,  the  measures  do  appear  to  have  captured  variation  unique 
to  the  role  and  effectiveness  of  each  leader  within  the  overall 
leadership  process  in  the  organizational  context.6  In  this 
respect,  CAL's  framework  provided  a  meaningful  basis  for 
assessment  of  organizational  leadership.  The  measurement  method, 
and  possibly  the  leadership  framework  itself,  did  not  yield 
performance  assessments  that  were  independent  for  the  two 
leadership  roles  or  that  clearly  differentiated  leadership 
processes  from  organizational  effectiveness. 

This  assessment,  it  should  be  noted,  describes  a  judgment 
process  congruent  with  the  primary  focus  and  operating  principles 
of  the  Army's  CTCs.  The  CTCs  focus  on  providing  collective 
training  in  highly  realistic  simulations  of  combat  and  not  the 
training  of  individual  soldiers  outside  of  their  organizations. 
Given  this  focus,  units  tend  to  be  appraised  at  the 
organizational  level,  that  is,  on  the  unit  tasks  pertinent  to  a 
mission  or  the  organizational  functions  involved  in  mission 
performance.  Methods  that  allow  for  independent  assessment  of 
individual  leadership  positions  would  possibly  require  a  change 
in  this  focus  or  direct  more  resources  at  measurement  than  the 


6  In  faot,  if  the  correlations  both  involving  MA-PERF  and 
crossing  PLs  and  PSGs  were  deleted  from  Table  3,  the  remaining 
correlations  would  provide  relatively  strong  support  for  the 
measurement  method.  The  MA-PERF  measures  would  have  centered  on 
the  halo  effects  of  unit  effectiveness  and  organizational 
leadership  processes  since,  as  indicated  earlier,  they  were 
averages  of  at  least  20  judgments. 
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methods  used  in  this  effort.  This  assessment  also  points  to  the 
need  for  sound  measures  of  unit  performance. 

ISSUES  OF  LEADERSHIP 
Leader  Performance-Unit  Effectiveness 

The  strong,  positive  relationships  between  leadership  task 
performance  (MA-Perf  and  SUM-Perf)  and  unit  effectiveness  were 
presented  in  the  section  on  validation  (Table  3) .  As  discussed 
there,  these  data  support  the  view  that  leadership  processes  in  a 
unit  are  important  elements  of  unit  effectiveness.  The  ratings 
of  the  importance  of  leadership  for  mission  accomplishment 
directly  indicate  this  view.  While  the  impact  of  leadership 
performance  on  unit  effectiveness  is  not  the  main  focus  of  this 
report,  the  apparently  high  impact  indicated  in  these  data 
suggests  the  potential  for  improving  unit  effectiveness  through 
improvements  in  leadership  development. 

Results  from  ARI's  earlier  NTC  research  (Rachford  et  al., 
1986)  suggested  the  possibility  that  the  leadership-unit 
effectiveness  relationship  was  higher  for  PLs  than  PSGs.  Such  a 
result  would  be  consistent  with  the  traditional  view  that  the  PL 
is  the  primary  direotor  of  platoon  activities  in  the  field. 
However,  current  results  do  not  indicate  differences  between  PLs 
and  PSGs  in  the  strengths  of  relationships  between  leadership 
performance  and  platoon/unit  effectiveness. 

Platoon  Leader  Leadership 

Table  7  summarizes  judgments  of  PL  leadership  performance 
made  at  the  end  of  the  rotation  (SUM) .  It  also  contains 
correlations  between  these  judgments  and  SUM  judgments  of 
platoon/unit  effectiveness. 

On  all  tasks,  means  were  similar  and  suggest  little 
variation  acroas  tasks  in  average  quality  of  performance  and, 
therefore,  judgments  describing  the  quality  of  PL  leadership 
performance  as  having  been  between  "below  standard"  and  "meeting 
standard"  on  each  task.  SUM  judgments  of  each  leadership  task 
were  significantly  correlated  with  perceived  platoon 
effectiveness  during  the  rotation.  Of  the  13  tasks,  nine  showed 
strong  correlations  (of  about  .6)  with  SUM-EFF;  even  the  lowest 
correlation  was  moderately  high  (.40). 

Table  8  displays  correlations  between  SUM  judgments  of  PL 
performance  on  each  task  and  SUM-EFF  judgments  of  PL 
effectiveness.  Table  8  also  summarizes  the  frequency  that 
platoon  OCs  nominated  each  task  as  one  of  the  "four  most 
important"  for  PL  effectiveness  in  exercises  like  those  at  the 
NTC.  In  Table  8,  tasks  are  ordered  in  the  frequency  (from  most 
to  least)  of  nomination  as  most  important. 
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Table  7 

Platoon .Leader  (PL1  Leadership  Task  Performance  and  Platoon/Unit 
Effectiveness 


Level  of  Task  Correlation  with 

Perfonnariss-  Platoon 

Leadership  Task  Mean  _ Effectiveness 


Planning 

2.1 

.7 

.58 

Communication 

2.4 

.7 

.55 

Supervision 

2.2 

.8 

.65 

Initiative 

2.3 

.8 

.59 

Soldier/Team 

Development 

2.5 

.8 

.60 

Decision  Making 

2.3 

.8 

.65 

Teaching/Counsel ing 

2.2 

.8 

.62 

Technical/Tactical 

2.3 

.7 

.49 

Flexibility 

2.5 

.8 

.59 

Innovation 

2.2 

.7 

.40 

Boldness 

2.4 

.7 

.48 

Trust  in  Subordinates 

2.3 

.8 

.54 

Motivate  subordinates 

2.6 

.9 

.58 

Note.  End-of --rotation  (SUM)  ratings  of  levels  of  PL  performance^ 
with  first  nine  tasks  rated  all  rotations  (q  -  82-85) ,  innovation 
and  boldness  rated  last  two  rotations  (n  ■  53,  56,  respectively), 
and  trust  in  subordinates  and  motivation  rated  first  mission  only 
(a  ■  28,  29,  respectively).  Correlations  (all,  a  <  .01)  of  SUM 
ratings  of  PL  performance  with  SUM  ratings  of  platoon/unit 
effectiveness,  with  sample  sizes  comparable  to  those  for 
corresponding  mean  levels  of  performance  ratings. 


Table  8 


Leadership  Tasks  Associated  with  Platoon  Leader  (Pin  Leadership 

Effectiveness 


Leadership  Task 

Correlation  with 
Platoon^Leader 

Selection  as 
"Most  Important" 
Frequency  Rank 

Planning 

.67 

47 

1 

Technical/Tactical 

.51 

42 

2 

Communication 

.61 

35 

3 

Decision  Making 

.51 

32 

4 

Initiative 

.60 

25 

5 

Supervision 

.65 

15 

6 

Flexibility 

.59 

13 

7 

Teaching/Counseling 

.61 

5 

8 

Boldness 

.68 

5 

9 

Soldier/Team  Development  . 61 

3 

10 

Innovation 

.56 

1 

11 

Note.  Correlations  of  end-of -rotation  ratings  of  PL  leadership 
performance  (SUM-PERP)  with  SUM-EPF  ratings  of  PL  leadership 
effectiveness ,  (ns  of  53-56) .  All  correlations  statistically 
significant  (p  <  .01).  Frequency  of  selection  (and  ranking  of 
frequencies)  as  one  of  four  "most  important  components  for 
platoon  leader  effectiveness"  by  platoon  OCs  at  end  of  two  later 
rotations. 


As  the  results  on  measurement  validity  might  predict ,  the 
correlations  in  Table  8  closely  approximate  those  in  Table  7. 

That  is,  all  were  moderately  to  strongly  correlated  (and 
statistically  significantly  so)  with  perceived  overall  PL 
leadership  effectiveness.  More  differentiation  in  associations 
of  leadership  performance  and  effectiveness  was  forced  by  the 
nominations  of  most  Important  tasks.  The  four  most  frequently 
nominated  for  PLs  were  planning,  technical/tactical  proficiency, 
communication,  and  decision  making.  Over  half  of  the  platoon  OCs 
serving  in  this  research  nominated  each  of  those  four  tasks. 

To  the  extent  that  leadership  was  actually  judged  on  the 
basis  of  the  performances  of  PLs,  the  mean  ratings  of  task 
performance  suggest  that  PL  performance  can  be  improved  by  leader 
development  programs  clearly  focused  on  the  leadership  tasks  in 
CAL's  framework.  However,  such  a  conclusion  should  be  made 
cautiously  given  the  halo  in  the  data.  The  halo  likely 
exaggerated  correlations  with  effectiveness  and  masked 
differences  both  in  associations  with  leadership  and  unit 
effectiveness  and  in  needs  for  improvement  inferred  from  these 
differences.  Also,  results  presented  earlier  indicated  that 
judgments  of  a  leader's  performance  were  not  independent  of  unit 
effectiveness  and  the  leadership  processes  in  a  unit. 

The  leadership  tasks  nominated  by  OCs  as  most  important 
emphasize  aspects  of  the  PL  role  oriented  on  effective  task 
accomplishment  by  the  unit:  sound  teohnical/tactical 
performance,  planning  for  effective  use  of  this  performance 
capability,  and  taking  actions  (making  decisions  and 
communication)  for  implementation  of  plans.  This  view  is 
generally  confirmed  by  results  from  two  related  efforts. 

After  returning  to  their  home  posts,  a  sample  of  unit 
members  in  the  first  rotation  reported  here  were  presented  the 
list  of  11  leadership  tasks  (see  Table  1)  for  which  OCs  had  made 
SUM  performance  judgments  (O'Mara,  1989).  They  then  assigned 
each  to  one  of  three  categories  of  relative  criticality  for 
combat  mission  performance:  "critical",  "important",  or  "less 
important."  A  total  of  49  squad  members  and  squad  leaders 
performed  this  task,  under  instructions  to  identify  the  four 
tasks  most  critical  for  PL  leadership.  The  four  tasks  most 
frequently  identified  matched  those  most  frequently  nominated  by 
OCs:  planning  (80%),  decision  making  (about  77%), 
teohnical/tactical  (about  75%) ,  and  communication  (about  55%) . 
When  company  commanders  (a  -  8)  made  the  sorting,  a  somewhat 
different  set  of  tasks  emerged  as  most  critical  for  PL 
performance.  For  company  commanders,  initiative  and  motivating 
others  tied  as  most  frequently  identified  (about  78%)  ,  with 
technical/tactical  proficiency,  soldier/team  development,  and 
teaching/counseling  tied  as  the  next  most  frequently  nominated 
(about  45%) . 
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Results  of  a  second  investigation  replicated  the  nomi¬ 
nations  of  OCs  and  the  squad  members  and  squad  leaders.  In  that 
effort  (Julian  &  siebold,  1990;  Oliver  &  Julian,  1990),  leaders 
in  a  battalion  having  completed  a  JRTC  rotation  indicated  which 
three  of  10  leadership  tasks  (the  nine  common  to  all  three  rota¬ 
tions  here,  plus  "professional  ethics")  were  most  important  for 
JRTC  effectiveness.  The  three  tasks  that  the  participating  PSGs 
(n  -  14)  most  frequently  identified  for  PL  performance  were: 
planning  (86%),  technical/tactical  proficiency  (57%),  and  deci¬ 
sion  making  (64%) .  Squad  leaders  (n  -  42)  most  frequently 
identified  planning  (81%)  and  communication  (64%)  as  most  impor¬ 
tant  for  PLs;  decision  making,  technical/tactical  proficiency, 
and  flexibility  were  closely  tied  as  the  third  most  frequent 
selection  (about  40%) .  Company  commanders  and  higher  leaders 
most  frequently  chose  technical/tactical  proficiency  (62%) , 
initiative,  and  decision  making  (50%  for  both  of  the  latter) . 

Thus,  there  appears  to  be  general  agreement  between  NTC  OCs 
and  PLs'  subordinates  about  the  PL  tasks  that  are  relatively  most 
important  for  unit  success  in  tactical  setting.  These  are  tasks 
directly  involved  in  accomplishment  of  assigned  mission. 
Additional  data  from  superiors  are  needed  to  determine  whether 
these  role  perceptions  are  shared  by  leaders  senior  to  PLs. 

Platoon  Sergeant  Leadership 

Table  9  summarizes  judgments  of  PSG  leadership  performance 
made  at  the  end  of  the  rotation  (SUM).  It  also  contains 
correlation  between  these  SUM  judgments  and  SUM-EFF  of 
platoon/unit  effectiveness. 

As  for  PLs  (Table  7),  mean  judgments  of  PSGs'  performance 
levels  varied  little  across  tasks  and  consistently  described  the 
quality  of  PSG  leadership  performance  as  having  fallen  between 
"below  standard"  and  "meeting  standard."  Correlations  of  SUM 
judgments  of  task  performance  and  SUM-EFF  for  the  platoon/unit 
were  significant  and  moderately  strong  to  strong.  Two 
correlations  seem  to  stand  out  as  relatively  stronger: 
supervision  and  teaching/counseling. 

Table  10  displays  correlations  between  SUM  judgments  of  PSG 
performance  of  each  task  and  summary  judgments  of  overall  PSG 
leadership  effectiveness  (PSG  SUM-EFF).  Table  10  also  summarizes 
the  frequency  that  OCs  nominated  each  task  as  one  of  the  "four 
most  important"  for  PSG  effectiveness  in  combat  exercises. 

As  for  the  PL  ,  the  strengths  of  the  correlations  in  Table 
10  closely  approximate  the  correlations  with  platoon/unit 
effectiveness  (Table  9) .  That  is,  all  were  moderately  to 
strongly  correlated  (and  statistically  significantly  so)  with 
perceived  overall  PSG  leadership  effectiveness.  Supervision 
again  showed  a  somewhat  stronger  association. 
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Table  9 

Platoon  Sergeant  (PSG)  Leadership  Task. Performance- and 
Platoon/Unit  Effectiveness 


Correlation  with 
Platoon 


Level  of  Task 

Performance 


Leadership  Task 

Mean 

Std.  Dev 

Effective 

Planning 

2.2 

.7 

.48 

Communication 

2.4 

.7 

.44 

Supervision 

2.3 

.8 

.66 

Initiative 

2.3 

.8 

.52 

Soldier/Team 

Development 

2.6 

.8 

.49 

Decision  Making 

2.3 

.8 

.54 

Teaching/Counseling 

2.3 

.8 

.61 

Technical/Tactical 

2.3 

.8 

.46 

Flexibility 

2.5 

.8 

.42 

Innovation 

2.3 

.7 

.44 

Boldness 

2.3 

.7 

.41 

Trust  in  Subordinates 

2.5 

.8 

.50 

Motivate  Subordinates 

2.6 

.9 

.49 

Note.  End-of-rotation  (SUM)  ratings  of  levels  of  PSG 
performance,  with  first  nine  tasks  rated  all  rotations  (n  ■  82- 
85),  innovation  and  boldness  rated  last  two  rotations  (n  «  53, 

56,  respectively),  and  trust  in  subordinates  and  motivation  rated 
first  mission  only  (n  «  27,  28,  respectively).  Correlations 
(all,  u  <  *01)  of  SUM  ratings  of  PSG  performance  with  SUM  ratings 
of  platoon/unit  effectiveness,  with  sample  sizes  comparable  to 
those  for  the  corresponding  means  of  level  of  performance 
ratings. 
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Table  10 

Leadership  Tasks  Associated  with  Platoon  Sergeant  (PSG) 
Leadership  Effectiveness 


Correlation  with  Selection  as 

Platoon  Sergeant 


LaadflEihija  laafc 

Planning 

Technical/Tactical 

Communication 

Decision  Making 

Initiative 

Supervision 

Flexibility 

Teaching/Counseling 

Boldness 


.48 

.42 

.64 

.62 

.66 

.73 

.43 


"Meat  Important'.! 
Frequency  b&qK 

9  7 

35  3 

26  4 

7  8 

18  6 

49  1 

6  9 

26  5 

2  11 

42  2 

4  10 


.57 
.59 

Soldier/Team  Development  .63 
Innovation  .49 


Note.  Correlations  of  end-of-rotation  ratings  of  PSG  leadership 
performance  (SUM-PERF)  with  SUM-EFF  ratings  of  PSG  leadership 
effectiveness,  (qs  of  53-56).  All  correlations  statistically 
significant  (p  <  .01).  Frequency  of  selection  (and  ranking  of 
frequencies)  as  one  of  four  "most  important  components  for 
platoon  sergeant  effectiveness"  by  platoon  OCs  at  end  of  two 
later  rotations. 


In  Table  10 ,  the  order  of  task  presentation  replicates  the 
order  in  Table  8  to  allow  comparison  of  the  tasks  nominated  as 
"most  important"  for  PLs  and  PSGs.  Readily  apparent  is  that  the 
two  most  frequently  nominated  for  PSGs— supervision  and 
soldier/team  development — were  not  among  the  tasks  most 
frequently  nominated  for  PLs.  The  third  and  fourth  most 
frequently  nominated  for  PSGs,  however,  were  the  second  and  third 
most  frequently  nominated  for  PLs:  technical/tactical 
proficiency  and  communication. 

These  findings  reinforce  the  implications  for  training 
discussed  earlier  for  PLs.  They  seem  to  add  the  importance  of 
taking  into  account  differences  in  leadership  roles.  More 
specifically,  the  data  suggest  that  tasks  representing  domains 
such  as  technical/tactical  proficiency  and  communication  are 
commonly  critical  to  both  PLs  and  PSGs.  However,  the  criticality 
of  other  leadership  tasks  varies  with  the  leadership  role.  The 
findings  suggest,  for  example,  that  supervision  and  soldier/team 
develop  are  relatively  more  significant  for  PSGs.  However,  the 
findings  are  not  consistent  as  to  whether  these  or  other  tasks 
distinguish  the  role  of  PSG.  Squad  members  and  squad  leader  (n  - 
49)  in  the  unit  having  trained  at  the  NTC  (O'Mara,  1989)  also 
identified  the  four  most  critical  tasks  for  PSG  performance. 

Most  frequently  selected  was  communication  (about  62%) ,  followed 
almost  equally  frequently  (about  45%)  by  planning,  decision 
makings,  soldier/team  development,  and  technical/taotical 
proficiency.  In  the  unit  having  trained  at  the  JRTC  (Oliver  & 
Julien,  1990),  PSGs  (n  *  14)  selected  the  tasks  most  important 
for  their  own  role.  The  order  of  selections  was:  communication 
(64%) ,  followed  by  technical/  tactical  proficiency  (50%) ,  and 
with  planning  and  initiative  tied  as  the  third  most  important 
(43%) .  Results  of  this  and  the  other  two  investigations  point  to 
the  tasks  also  important  to  PLs— technical/tactical  proficiency 
and  communication.  However,  the  data  do  not  consistently 
indicate  the  importance  of  supervision  or  soldier/team 
development  for  PSGs. 

Ihs  PL-Psg  Leadership  laam 

Table  3  shows  that  the  leadership  performance  of  the  PL  and 
PSG  wero  positively  correlated:  platoons  with  effective  PLs 
tended  to  have  effective  PSGs  and  vice  versa.  These  results, 
combined  with  the  leader-unit  performance  correlations,  suggest 
that  although  a  unit  may  sometimes  do  well  with  only  one 
effective  leader,  effective  unit  performance  is  usually 
associated  with  the  effectiveness  of  both  the  PL  and  PSG.  This 
view  is  supported  by  prior  NTC  research  (Rachford  et  al.,  1986: 
Twohig  &  Tremble,  1987a)  and  data  from  the  first  rotation  on 
components  of  the  PL-PSG  relationship  (Appendix  E) .  It  is  also 
supported  by  OC  field  notes  that  attributed  improvements  in 
platoon  performance  to  improvements  in  the  PL-PSG  working 
relationship. 
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These  results  generally  describe  the  effective  PL-PSG 
relationship  as  a  team  of  leaders  who  are  competent  as 
individuals  and  who  have  a  relationship  in  which  they  share- 
through  consultation  and  information  exchange — their  skills.  In 
addition  to  sharing,  the  effective  PL-PSG  relationship  involvas 
mutually  and  clearly  recognized  areas  of  responsibility.  The 
various  role  allocations  possible  and  conditions  affecting  their 
effectiveness  and  development  are  important  topics  for  further 
research. 

As  discussed  earlier,  the  strength  of  the  PL-PSG 
correlations  may  have  partly  reflected  a  halo  effect  from  the 
judged  quality  of  the  organizational  processes  served  by  the 
leadership  tasks  of  both  the  PL  and  PSG.  The  notes  made  by  OCs 
and  SMEs  reflected  the  view  that  such  processes,  and  the 
leadership  tasks  involved  in  them,  are  the  joint  responsibilities 
of  PLs  and  PSGs.  For  example,  field  notes  indicated  that  while 
PSGs  may  have  primary  responsibility  for  carrying  out  such 
specific  supervisory  activities  as  pre-combat  inspections,  PLs 
remain  accountable  for  those  activities  due  to  their  overall 
responsibility  for  the  quality  of  platoon  supervision. 

Similarly,  PLs  were  viewed  as  primarily  rosponsible  for  planning, 
but  PSGs  are  expected  to  contribute.  Thus,  the  high  correlations 
possibly  indicate  views  and  assumptions  about  the  shared 
responsibilities  and  contributions  of  PLd  and  PSGs  to  the 
leadership  processes  represented  by  the  leadership  tasks. 

CAL'-S,  Leadership  Framework 

These  findings  indicate  that  the  leadership  tasks  in  CAL's 
framework  are  related  to  leadership  and  unit  effectiveness.  If 
the  assessment  presented  earlier  is  correct,  evidence  is  clearest 
about  (1)  the  importance  to  unit  effectiveness  of  the 
organizational  processes  represented  by  CAL's  tasks  and  (2), 
within  this  context,  the  importance  of  the  combined  tasks  to 
leadership  effectiveness.  However,  the  data  collected  through 
the  performance  measures  probably  yielded  spuriously  high 
estimates  of  the  importance  of  the  tasks  and  did  not  show 
differences  in  the  relative  importance  of  the  leadership  tasks. 

While  the  performance  measures  failed  to  discriminate 
between  the  importance  of  the  leadership  tasks  in  CALs1 
framework,  OCs'  task  nomination  provided  some  indication  of  the 
relative  importance  of  the  tasks  for  PLs  and  PSGs.  Each  task  was 
nominated  by  at  least  one  OC  for  both  PLs  and  PSGs.  This 
indicated  the  importance  of  all  tasks.  For  PLs,  the  tasks  most 
frequently  nominated  by  OCs  corresponded  with  nominations  made  by 
unit  members  as  part  of  other  investigations.  This  indicates  a 
relatively  clear  role  definition  for  PLs  that  centers  on 
leadership  tasks  directly  pertinent  to  mission  performance: 
planning,  technical/tactical  proficiency,  communication,  and 
decision  making.  Task  nominations  did  not  yield  role  definitions 
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for  PSGs  that  corresponded  with  results  of  related  research. 

This  discrepancy  for  PLs  and  PSGs  and  yet  the  apparent 
interdependence  of  their  performance  leadership  effectiveness 
points  to  the  importance  of  research  on  aspects  of  team 
leadership.  Such  research  is  significant  since  role  expectations 
were  possibly  a  basis  for  the  judgment  process  described  earlier: 
judgments  of  task  quality  in  terms  of  observations  or  inferences 
about  a  leaders'  contributions  to  organizational  processes. 

CAL's  goal  is  a  leadership  model  that  has  general 
applicability  and  that  is  yet  useful  for  leader  assessment.  To 
guide  assessments  of  individual  leaders,  it  may  be  necessary  to 
refine  the  present  framework  by  tailoring  task  descriptions  and 
standards  to  the  level  of  leadership  to  which  they  apply.  Such  a 
refinement  could  yield  measures  that  better  differentiate  between 
leaders  and  between  their  performance  of  different  tasks. 

Even  with  more  differentiated  task  definitions,  the  task 
structures  for  leadership  roles  may  be  such  that  separate 
leadership  tasks  and  their  assessment  will  remain  correlated  to 
some  extent.  This  has  been  suggested  by  API's  research  on  leader 
performance  requirements.  Through  successive  interviews  with 
small  groups  of  leaders,  the  leader  requirements  research 
identified  560  leader  tasks  and  20  categories,  referred  to  as 
duty  areas,  into  which  the  tasks  were  placed.  Questionnaires 
were  then  administered  to  commissioned  and  noncommissioned 
officers  who  rated  the  significance  of  each  task  to  their  current 
duty  positions.  For  both  commissioned  (Steinberg  &  Leaman, 

1990b)  and  noncommissioned  (Steinberg  &  Leaman,  1990c)  officers, 
the  duty  areas  provided  a  meaningful  framework  for  describing 
differences  in  the  significance  of  tasks  to  leaders  in  different 
ranks,  in  different  leadership  positions,  etc.  The  significance 
ratings  were  later  factor  analyzed  (Steinberg  &  Leaman,  1990a) . 
Rather  than  replicating  the  duty  areas,  the  factors  were  often 
defined  by  tasks  from  more  than  one  duty  area.  These  findings 
seem  to  indicate  that  the  structure  of  leadership  is  such  that 
while  separate  leadership  components--broad  tasks  (CAL)  or  duty 
areas— can  be  identified,  they  are  actually  interdependent  in  the 
on-the-job  performances  representing  them.  To  the  extent  that 
the  leadership  components  are  themselves  interdependent,  this 
interdependence  will  likely  be  found  (and,  depending  on  the 
purpose  of  assessment,  perhaps  should  be  found)  in  performance 
assessments  made  in  on-the-job  settings  or  realistic  simulations 
of  such  settings. 

PERFORMANCE _ IN  TACTICAL  SIMULATIONS 

Post  rotation  group  discussions  and  field  notes 
(separate  for  OCa  and  SMEs)  produced  information  on  the 
measurement  methods  used  in  this  research.  Information  pertinent 
to  possibilities  for  refinement  is  summarized  here. 
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Examination  of  information  from  tha  group  discussions 
suggsstsd  that  SMEs  had  usad  thraa  ganaral  typas  or  oategorias  of 
information  in  thair  attampts  to  judga  parformanoa  of  tha 
laadarship  tasks.  Two  of  tha  oatagorias  ara  as  indioativa  of 
organizational  laadarship  prooassas  as  thay  ara  of  tha 
parformanoas  of  individual  laadars.  One  of  thasa  oatagorias 
oonsistad  of  outcomes  pertinent  to  tha  tasks.  This  included 
outcomes  associated  with  performance  of  tha  overall  unit  (e.g., 
mission  accomplishment) ,  with  tha  performance  expected  of 
subordinate  leaders  (e.g.,  correct  execution  of  assigned  or 
implied  tasks) ,  or  with  tha  state  of  tha  unit  or  its  members 
(e.g.,  subordinates1  understanding  of  tha  mission,  properly 
dressed  soldiers,  properly  maintained  equipment).  Tha  second 
category  involved  adherence  to  procedures  presumed  to  help  leader 
effectiveness.  Examples  were  requests  for  "brief backs"  from 
subordinates,  delegation  of  tasks,  and  consultation  with 
subordinates.  The  third  category  more  directly  focused  on  the 
leader  judged  and  consisted  of  tasks  or  behaviors  that  could  be 
personally  observed  by  the  SME  and  that  directly  represented  or 
exemplified  a  leadership  component. 

The  notes  recorded  by  ocs  in  the  last  two  rotations 
identified  leader  behaviors  that  they  had  considered  important  in 
judging  leader  performance.  Notes  were  made  for  the  five  tasks 
judged  per  mission. 

For  planning,  OCs  sometimes  examined  the  comprehensiveness 
of  the  produced  plan  and  whether  it  was  more  than  repetition  of 
the  company  plan.  This  involved  examining  whether  the  plan  was 
sufficiently  detailed  and  whether  it  included  all  activities 
(such  as  security  and  logistics)  important  to  the  mission.  OCs 
also  noted  whether  the  plan  was  tactically  sound.  The 
organization  of  the  plan  and  correct  prioritization  of  tasks  were 
also  important.  It  was  important  that  the  plan  include  steps, 
such  as  conducting  rehearsals  and  reconnaissance,  that  can  easily 
be  neglected  due  to  other  more  immediately  pressing  demands. 
Contingency  plans  were  also  mentioned  as  a  sign  of  good  planning. 
Comments  were  made  as  to  whether  PSGs  had  consulted  on  the  plan 
and  had  made  needed  suggestions  for  improvement. 

The  most  frequently  noted  characteristic  of  effective 
communication  was  keeping  subordinates  informed,  which  was  seen 
as  a  responsibility  of  both  the  PL  and  the  PSG.  The  next  most 
frequently  noted  areas  were  command  and  control  and  good 
communication  with  company  level,  which  were  more  frequently 
mentioned  in  terms  of  PL  performance.  Platoon-level  leaders  were 
expected  to  question  superiors  to  clarify  their  understanding. 
Effective  communication  depended  on  PSGs'  keeping  their  PLs 
informed.  Effective  communication  was  also  seen  to  depend  on 
certain  specific  skills  and  techniques  such  as  clarity  of 


expression,  good  briefing  skills,  use  of  graphics,  and  the  use  of 
alternative  means  of  communication  (like  signal  flags). 

For  effective  supervision,  the  key  behaviors  involved  clear 
task  specification  followed  by  checks  on  task  completion/quality. 
Pre-combat  checks  were  discussed  as  an  important  part  of  the 
PSG's  role  in  supervision.  Supervision  during  mission  execution 
was  also  noted,  for  instance,  actions  insuring  the  platoon  was  in 
the  correct  movement  formation.  Certain  techniques  for 
supervision  were  mentioned  such  as  use  of  subordinate  leaders  to 
check  on  conditions,  sometimes  during  "backbriefs",  and 
observation  of  rehearsals  to  determine  task  understanding. 

For  soldier/team  development,  OCs  focused  on  the  maintenance 
of  combat  readiness  and  teamwork.  Notes  indicated  that  effective 
leaders  had  done  such  things  as:  used  slow  periods  to  conduct 
training  in  team  and  individual  skills,  enforced  discipline 
standards,  and  attended  to  subordinates'  physical  needs. 

For  initiative,  effective  leaders  ware  described  as  having 
made  decisions  to  improve  their  unit's  immediate  situation.  For 
some  OCs,  initiative  meant  making  changes  in  previously  planned 
action,  and  failure  to  make  such  changes  signified  a  lack  of 
initiative.  Taking  over  for  a  "slain"  or  absent  leader  provided 
one  opportunity  for  showing  initiative.  These  examples  define 
initiative  in  terms  of  non-routine  situations,  other  examples 
seemed  to  describe  relatively  standard  leader  responsibilities, 
such  as  conducting  rehearsals  or  inspections.  The  SMBs  in  the 
first  rotation  had  given  similar  examples  and,  when  questioned 
about  them,  concluded  that  such  examples  had  been  signs  of 
proaotivitv  by  the  leader.  The  point  seems  to  have  been  that 
effective  leaders  need  to  keep  going  and  take  actions  to  improve 
their  unit's  preparation  or  execution,  without  direct 
instructions  to  do  so. 

The  three  categories  of  outcomes,  procedures,  and 
performances  have  somewhat  loose  boundaries,  but  their 
delineation  may  help  in  planning  and  in  instructing  observers  on 
the  evidence  that  can  or  should  serve  as  standardized  indicators 
of  performance  quality.  Discussions  with  the  SMEs  underscored 
some  of  the  challenges  in  developing  such  guidance.  They  include 
variation  by  leadership  task  in  the  kinds  of  evidence  available 
for  judging  task  performance.  They  also  include  a  factor  already 
discussed:  overlap  in  the  evidence  indicative  of  task 
performance.  In  a  complex  performance  setting  like  the  NTC,  one 
piece  of  evidence  is  not  necessarily  indicative  of  one  task 
exclusively.  Rather,  the  evidence  may  relate  to  several 
leadership  tasks.  For  example,  if  leaders  supervise  to  see  if 
subordinates  are  using  slack  time  usefully,  they  make  take  the 
initiative  to  set  up  some  training  with  an  effect  on  soldier/team 
development.  The  training  will  require  some  planning,  and  its 
execution  will  require  some  form  of  communication  (at  least  of 
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instructions) .  Thus,  when  a  leader  performs  a  related  set  of 
behaviors,  several  leadership  tasks  may  be  involved.  To  the 
extent  that  separate  assessment  of  each  of  CAL's  leadership  tasks 
is  important,  future  development  of  measurement  methods  needs  to 
seek  approaches  that  yield  judgments  based  on  evidence  which,  to 
the  extent  possible,  is  unique  to  each  task  judged. 

Conditions  Affectlnq_Measurement 

In  addition  to  the  performance  iru^uator  *  available  for 
judging  leadership,  the  group  discussions  produced  information 
about  conditions  of  performance  in  a  simulated  combat  setting 
that  could  affect  judgments  of  leadership.  Such  conditions  also 
need  to  be  dealt  with  in  further  development  of  a  leader 
performance  measurement  system.  The  principal  conditions 
included: 

(a)  Involvement  of  a  platoon  in  the  execution  phase  of  the 
mission.  This  determined  the  opportunities  available  for 
observation  of  leadership  in  the  execution  phase. 

(b)  Actions  of  superior  leaders  that  affected  the  types  and 
amounts  of  activities  in  which  subordinate  leaders  could  engage. 
Frequently  discussed  examples  were  "micromanagement"  by  superior 
leaders  and  the  timing  of  receipt  of  operations  orders  from  the 
next  higher  echelon  that  restricted  subordinate  leaders' 
opportunities  to  exercise  their  own  planning  skills. 

(c)  Quality  of  other  leaders  in  the  team  and  the  working 
relationships  among  leaders.  These  were  often  cited  as 
conditions  that  could  detract  from  (or  were  needed  for)  the 
manifest  quality  of  performance  of  a  single  leader  in  the  team. 

(d)  Potential  need  for  more  information  than  may  be 
available  for  attributing  "cause."  That  is,  it  was  sometimes 
found  that  without  other  contextual  information,  an  objective 
indicator  was  insufficient  for  confident  attribution  to  the 
capability  of  a  particular  leader.  For  example,  a  platoon's 
accomplishment  of  a  particular  task  can  be  insufficient  evidence 
of  leadership  effectiveness  without  additional  information  about 
the  orders  from  the  company  level  and  the  standard  operating 
procedures  under  which  the  platoon  was  operating. 

(e)  Opportunity  for  observation  of  key  leader  behaviors. 
Various  conditions  were  identified  that  sometimes  prevented  the 
assembly  or  acquisition  of  evidence  which  was  otherwise 
available.  Such  conditions  are  probably  more  likely  when  an 
observer  has  to  monitor  more  than  one  leader. 
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SUMMARY  AND  CONCLUSIONS 

A  method  for  measuring  leadership  performance  in  tactical 
field  exercises  based  on  CAL's  framework  of  leadership  tasks  and 
standards  was  developed  and  applied  in  three  rotations  at  the 
NTC.  The  method  was  targeted  for  measuring  the  leadership  of  PLs 
and  PSGs  in  exercises  at  the  NTC.  The  method  called  for 
judgments  of  PL  and  FSG  leadership  performance  relative  to 
standard  by  platoon  OCs  both  for  the  separate  missions  of  an  NTC 
rotation  and  for  the  rotation  as  a  whole.  Platoon  OCs  also  made 
judgments  of  the  overall  leadership  effective  of  PLs  and  PSGs  and 
judgments  of  overall  unit  effectiveness  with  respect  to  mission 
accomplishment  in  order  to  assoss  the  measurement  of  leadership 
performance.  In  the  second  and  third  rotations,  Company  OCs  made 
judgments  of  PL  and  platoon/unit  effectiveness  to  assess  inter¬ 
rater  reliability  of  OC  judgments. 

The  data  support  the  following  conclusions: 

(1)  The  mnasurement  method  produaed  performance  judgments 
of  the  separate  leadership  tasks  for  a  leader  (PL  or  PSG)  that 
were  Interdependent  with:  platoon/unit  effectiveness, 
performance  of  different  tasks  by  the  same  leader,  and  perfor¬ 
mance  of  the  same  tank  by  the  two  different  leaders.  This 
interdependence  likely  inflated  the  numerical  estimates  of 
association  between  leadership  performance  and  unit 
effectiveness.  It  also  likely  masked  variation  in  the  measured 
performance  levels  of  the  leadership  tasks. 

(2)  CAL's  framework  defines  leadership  tasks  that  appear  to 
be  a  meaningful  basis  for  measuring  leadership  processes  in  a 
unit  and  the  relationship  of  these  processes  to  unit  performance 
in  realistic  taotioul  simulations.  Aggregated  measures  of  these 
tasks  for  a  leader  are  also  meaningfully  associated  with  the 
overall  leadership  effectiveness  of  the  leader. 

(3)  The  measurement  method  did  not  distinguish  differences 
between  the  tasks  and,  therefore,  differences  in  their  relative 
importance  to  leadership  or  unit  effectiveness.  For  OCs  and  unit 
members,  there  is  nevertheless  some  consistency  in  their  views  of 
the  leaderehip  tasks  that  are  most  important  for  unit  effective¬ 
ness  in  oombat  settings,  especially  the  tasks  important  for  PLs. 

(4)  The  leadership  performance  measurement  method  used  in 
the  present  research  needs  revision  so  as  to  yield  measures  of 
leadership  that  are  more  Independent  of  the  organizational 
leadership  processes  in  the  performance  setting  and  that  are  more 
independent  across  the  separate  components  of  leadership.  This 
may  require  a  more  elaborated  framework  of  leadership  that 
specifies  the  performance  attributes  that  distinctively 
differentiate  both  the  separate  leadership  components  and  the 
leadership  behaviors  expected  of  different  types  of  leaders. 
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APPENDIX  A 

END-OF-ROTATION  INSTRUMENT  FOR  OBSERVER  CONTROLLERS 

OC  TEAM  _ 

TASK  FORCE  _ 

COMPANY-TEAM  _ 

PLATOON  _ 

PARENT  BATTALION/COMPANY/PLATOON  _ 
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The  enclosed  instrument  was  used  after  rotations  2  and  3. 

A  somewhat  different  instrument  was  used  after  rotation  l.  (See 
Table  2  in  the  main  body  of  this  report  for  major  differences) . 
For  all  rotations,  the  observers  made  ratings  with  respect  to  11 
leader  performance  tasks.  The  same  9  were  rated  after  each 
rotation.  The  tasks  boldness  and  innovation  were  only  rated 
after  rotations  2  and  3,  as  shown  on  the  enclosed  instrument. 

For  rotation  1,  the  tasks  motivate  subordinates  and  trust  in 
subordinates  were  rated  rather  than  boldness  and  innovation. 

The  ratings  of  PL  and  PSG  effectiveness  shown  in  the 
enclosed  instrument  were  not  done  for  rotation  1  and  neither  were 
the  groupings  of  tasks  by  importance. 

Questions  unique  to  the  rotation  1  instrument  involved  the 
effects  of  sleep  and  conditions  that  affect  performance.  The 
full  rotation  1  instrument  is  avaiable  from  the  second  author. 


A-2 


LEADER  COMPETENCIES 


XMSTRDCTXON8 1 

For  the  next  two  pages,  bated  on  the  rotation  as  a  whole, 
please  indicate  how  well  the  Platoon  Leader  (PL)  and  the  Platoon 
Sergeant  (PSG)  in  your  platoon  performed  relative  to  doctrinal 
standards  for  each  of  the  11  competencies  listed. 

indicate  the  performance  level  for  the  PL  and  the  PSG 
separately.  Do  this  by  placing  an  X  under  the  appropriate  column 
for  the  performance  level,  along  the  row  marked  PL  for  the 
Platoon  Leader  and  the  row  PSG  for  the  Platoon  Sergeant. 

Performance  vs  Standard 


Par 

Below 

Somewhat 

Below 

Meets 

Standard 

Exceeds 

PLANNING 

Quality  of  plans; 

PL 

Time  iness  of  plans; 
Consult  with  subordinates 

PSG 

COMMUNICATION 

With  subordinates 

PL 

With  superiors 

With  other  units 

PSG 

SUPERVISION 

Specifies  tasks  clearly 

PL 

to  subordinates;  Checks 
on  performance  of  tasks; 

PSG 

Makes  sure  errors  cor¬ 
rected 

INITIATIVE 

Acts  without  direct  orders 
to  accomplish  mission  PL 

Intent;  Requests  that 
supervisors  reconsider 

PSG 

approach  based  on  new 
'information 

80LDXIR/TIAM  DEVELOPMENT 
Builds  teamwork; 

PL 

— 

- 

Takes  care  of  soldier 
needs;  Maintains 

PSG 

discipline 
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LEADER  COMPETENCIES  (Continued) 


OVERALL  MISSION  PERFORMANCE 


in  this  section,  circle  the  alternative  below  a  question 
that  best  describes  your  response  about  the  Platoon  and  leaders 
that  you  observed  in  this  rotation. 


1.  For  this  rotation  as  a  whole,  how  effective  was  this 
Platoon  as  a  unit  in  accomplishing  its  missions? 

poor  Only  Fair  Good  Excellent 

2.  For  this  rotation  as  a  whole,  how  effective  was  the 

Platoon  Leader  as  a  leader? 

Poor  Only  Fair  Good  Excellent 

3.  For  this  rotation  as  a  whole,  how  effective  was  the 

Platoon  Sergeant  as  a  leader? 

Poor  Only  Fair  Good  Excellent 

4.  For  this  rotation  as  a  whole,  how  effective  was  the 
platoon's  Company  Commander  as  a  leader? 

Poor  Only  Fair  Good  Excellent 


5.  in  the  platoon  which  you  observed,  how  effective  were  the 
squad-level  leaders  as  leaders  for  this  rotation  as  a  whole? 

Poor  Only  Fair  Good  Excellent 


6.  To  what  extent  did  the  leaders  at  company  level  and  above 
give  your  Platoon  Leader  and  Platoon  Sergeant  adequate 
opportunity  to  show  their  leadership  abilities  in  planning, 
preparation,  and  execution  of  missions  in  this  rotation? 

Highly  Rather  Border-  Somewhat  Decidedly 

Inadequate  Inadequate  line  Adequate  Adequate 
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LEADERSHIP  PERFORMANCE  AT  NTC 


The  11  leadership  competencies  are  again  listed  below. 
Spaces  are  provided  for  your  responses  about  the  leadership  of 
Platoon  Leaders  and  Platoon  Sergeants  in  general  - — that  is, 
based  on  all  your  observations  as  an  Observer/dontroller  in  NTC 
training  exercises. 

For  the  leadership  of  Platoon  Leaders,  which  of  the  four 
leadership  competencies  are  most  importa'nt  to  unit  (Platoon) 
combat  effectiveness? 

Indicate  your  responses  by  placing  an  X  in  the  space  under 
Platoon  Leader  for  each  of  the  four  leadership  competencies  that 
you  choose. 

After  answering  for  the  Platoon  Leader,  please  answer  again 
for  the  Platoon  Sergeant. 


Leadership  Platoon 

Competency  Leader 

Planning  _ 

Communication  _ 

Supervision  _ 

Initiative  _ 

Soldier/Team 

Development  _ 

Decision  Making  _ 

Teach/Counsel  _________ 

Innovation  _ 

Boldness  _ 

Flexible 

* 

technical/ 

Tactical  _ 

In  addition  to  the  11  competencies  listed  above,  are  there  other 
leadership  competencies  of  a  Platoon  Leader  or  platoon  Sergeant 
that  are  important  to  platoon  effectiveness  in  combat?  If  yes, 
please  describe  (below  and  on  the  back,  if  necessary)? 


Platoon 

Sergeant 
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APPENDIX  B 

STANDARDS/GUIDLINES  FOR  JUDGING 
PLATOON  LEADER  AND  PLATOON  SERGEANT  PERFORMANCE 
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LEADERSHIP  DATA  COLLECTION 


This  packet  defines  the  purpose  for  and  method  of  data 
collection  during  the  NTC  Rotation. 

PURPOSE  OF  DATA  COLLECTION 

To  obtain  information  to  aid  the  Center  for  Army  Leadership 
in  defining  Army-Wide  indicators  of  leadership  performance 
effectiveness  in  combat.  Definition  of  the  indicators  will  be  a 
long-term  process.  However,  onoe  defined,  the  indicators  will  be 
used  to  structure  leader  development  programs  in  Army  units  and 
schools. 


METHOD  OF  DATA  COLLECTION 

OCs  will  use  pocket-sized  cards  to  record  observations  on 
leader  performance  vs  standard.  At  the  end  of  the  rotation,  OCs 
will  participate  in  a  group  session  to  provide  information  on  the 
materials  used  during  the  rotation. 

More  specifically,  each  OC  is  to  complete  3  cards  for  each 
mission. 

On  the  front  of  each  card,  information  is  to  be  recorded  so 
that  the  completed  cards  can  be  accurately  organized  for  data 
analysis.  This  identification  information  is  as  follows: 

OC  Team  _  BN/CO/PLATOON  _  TF/CO-TBAM  _ 

DATE  _  BN/BDB  MIBB.  _  PLATOON  MXSS~  _ 

Definitions  for  the  identifiers  are  as  follows: 


OC  Team— OC  Team  to  which  the  OC  is  assigned  for  the  rotation. 

BN/CO/PLATOON— The  parent  BN,  CO,  and  PLATOON  of  the  Platoon 
being  observed/cont roiled  by  the  OC. 

TF/CO-TEAM— Unit  identifier  for  the  same  Platoon  but  in  terms  of 
the  task  force  organization  for  the  rotation. 

DATE— The  date  tne  mission  started. 

BN/BDE  MISS. — The  overall  Task  Force  or  Brigade  mission. 

PLATOON  MISS. — Mission  specific  to  the  Platoon, 


The  next  pages  describe  the  other  information  to  be  recorded 
on  the  three  cards  for  each  mission. 
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CARD  1 


Both  old**  of  Card  l  ara  to  ba  oomplatad  for  aach  miasion  in 
tha  rotation. 

8IDE  1  (FRONT) 

Uaa  8ida  1  of  Card  1  to  raoord  obaarvationa  of  tha  laval  of 
parformanea  of  tha  platoon  laadar  (PL)  and  platoon  aargaant  (PSG) 
on  aaoh  of  fiva  laadar ahip  compatanoiaas  Planning, 

Communication,  Suparviaion,  lnitiativa,  and  Soldiar/Taaa 
Davalopaant. 

For  aaoh  laadarahip  ooapatanoy  on  Card  1,  raoord  your 
obaarvationa  of  tht.liXSl-Ol-PlCggraingt  Pf  1-lfftdT  in 
C0lBPirl8iQa,.,t0.1t8ndard»  annex  A  oontaina  guidlinaa  on  tha 
maaninga  of  atandarda  and  tha  levala  of  parformanoa  for  aaoh 
compatanoy. 

Maka  aaoarata  obaarvationa  and  raoordinga  for  tha  PL  and  PSG 
for  aaoh  compatancy.  Raoord  your  obaarvationa  in  tha  appropriata 
column  and  row  on  tha  card  (aaa  balow) • 

For  axampla,  auppoaa  your  obaarvationa  indicata  that  tha  PL 
mat  atandarda  on  Planning.  Than  plaoa  an  X  undar  tha  Maata 
Standarda  column  and  in  tha  PL  row  for  Planning.  If  tha  PSG  had 
axoaadad  atandarda  for  planning,  than  an  X  would  ba  plaoad  undar 
that  column  and  in  tha  row  for  PSG  Planning. 


00  WAX. 
DAM  _ 


BM/eO/riATOOM 
AM/IDS  m««.  , 


PLT.  CARD  1 


VLMIMXIKI 

tlu  fualitj,  tlitlliiti 
OOKMUV2CATION 


aufiamxoM 
•pacify  tai 


xntiMin 

Exploit  opportualtlaa 

•oldzik/tian  wtolopkivt 
Itunrk/*wi  (or  troop* 


TJ/OO-1 
.  VIA  TOOI 

rsraiMt 

IJlM 

1  axIT - 

ra  limit! _ 

far 

niw 

•oaavhat 

JJlML. 

Maata 

itaaOard 

m 

n* 

• 

• 

o 

* 

n _ 

NO _ 

n _ 

NO _ 

n _ 

NO 

n _ 

NO _ 

n _ 

NO _ 
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CARD  1 


SIDE  2  (BACK) 

On  this  side,  writs  comment*  on  oonditions  that  af footed 
your  observations  about  the  level  of  performance  of  the  PL  and 
PS6  for  the  leadership  competencies. 

By  conditions,  we  meant 

(1)  Circumstances  that  impacted  on  the  opportunity  for  the 
leader  to  show  his  performance  ability  in  the  planning, 
preparation  or  execution  phases  of  the  mission. 

or 

(2)  Circumstances  that  affected  your  ability  to  get  relevant 
information  on  leader  performance. 


As  appropriate,  provide  comments  on  oonditions  separately 
for  the  PL  and  PSG. 


Condition*  Af footing  Judgments  Of i 
fL  LUOlUIIf  VERVOAXAMOS 


via  uuEMiir  nuouxiici 


CARD  2:  SIDES  X  AND  2 


This  card  has  spacs  for  written  notes*  The  notes  are  to 
summarise  the  reasons  for  your  observations  of  the  level  of 
performance  of  the  PL  and  PSG  for  each  leadership  competency . 

By  reasons,  we  meant 

What  you  observed,  in  the  mission,  that  led  to  your 
judgment  of  the  PL's  or  the  PSG's  performance. 

SIDE  1 

On  Side  1  of  Card  2,  write  your  comments  for  the  PL. 

00  TUN _  BN/OO/ PLATOON _  TP/00-T1A* _ ' 

DAT1  BM/BDI  Mill.  _ _ _  PLATOON  glT 

(PLT.  CAAD  t)  ituui  Per  JuBgaaafc  ef  PL  X*a4arafclp  Hrionuoi 
PLMWXMO 


OOKKTJNZ  CATION 


IDimillOM 


XNXTXATXT1 


•OLfilEA/TIAN  DEVELOP*?  NT 


SIDE  2 

On  Side  2  of  Card  2,  write  your  comments  for  the  PSG. 


taaaoaa  Per  Judpaaafc  ef  PBO  Laaderafaip  Parforeaaea 
PLAMMXMO 


OOXXUVXCATXOM 


BDP1KTXSX0M 


INITIATIVE 

•OLDXIR/TIAN  DEVELOPMENT 
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CARD  3 


Us*  card  3  to  rooord  your  observation*  in  a  mission  of  th* 
overall  performance  effectiveness  oft 

Tbs  PL  as  a  Leader 

The  PSG  as  a  Leader 

The  CO  (of  your  PL  ft  PSG)  as  a  Leader 

The  Platoon  as  a  Unit 

Also,  reoord  your  observation  of  hov  important  platoon  level 
leadership  performance  was  to  the  performance  of  the  platoon  in 
the  mission  (separately  for  the  PL  and  the  PS  J) • 

Again,  place  an  X  in  the  box  that  best  describes  your 
overall  observations. 

Additional  guidanoe  for  this  card  will  be  provided  prior  to 
th*  rotation. 


00  TEAM  _  BB/OO/PXATOOII _  TF/OO-TIAM _ 

DAT!  __2 _  BM/BDI  MX  >8.  .  PXATOOB  MXM. 


PLT.  CARD  3 

PL  aa  a  laadar 

■TT7 

7TTTT 

a 

r-~Qyj 

m 

MO  aa  a  laadar 

■ 

CO  aa  a  laadar 

FTwTVH  KTIiT-Hd  ■  m  »  pvTiWB 

■ 

■ 

■ 

Xaportaaoa  to  Platoon 

Miaalon  Aoooapliahaant 

lBoortanoa  of  FL  laadarahlo 

mm 

rrm 

Xapt. 

cxa 

Impartanoa  of.  PBO  loadarahlp 

Hot*. --The  back  of  CARD  3  is  blank.  Please  use  it  as  additional 
space  to  continue  written  comments  that  you  started  on  CARD  1  or 
on  Card  3. 


E 


ANNEX  B 

GUIDELINES  FOR  OBSERVATIONS 

This  Annex  contains  guidance  for  making  observations  during 
a  mission  on  leader  performance  with  respect  to  the  leadership 
competencies  of  Planning,  Communication,  Supervision,  Initiative, 
and  Soldier/Team  Development. 


DETERMINING  LEVEL  OF  LEADERSHIP  PERFORMANCE 


This  Annex  contains  one  page  of  guidance  for  each  of  the 
five  leadership  competencies.  This  guidance) 

*  Identifies  major  components  of  the  general  leadership 
competencies;  for  example,  "specifying  tasks"  is  a 
component  of  supervision. 

*  States  standards  of  performance  for  each  component,  based 
on  current  doctrine. 

*  Gives  descriptions  for  determining  level  of  performance 
during  a  mission  (from  "Far  Below"  to  "Exceeds")  in 
comparison  to  doctrinal  standards. 

*  Provides  examples  of  performances  for  each  competency 


USING  THE  GUIDANCE 


Major  components  of  each  leadership  competency  are 
Identified  on  the  next  pages. 

If  you  obtain  information  on  these  components  during  a 
single  mission,  give  equal  consideration  to  all  components  in 
determining  the  level  of  performance  on  the  leadership 
competency. 

If  the  available  information  does  not  cover  all  components 
of  a  leadership  competency,  base  your  determinations  on  this  more 
limited  information.  However,  you  may  also  decide  to  note  any 
information  limitation  as  a  condition  on  Side  2  of  card  1. 
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PLANNING 


component  a i  PI an. Quality 

Standard: 


Plana  focua  on  what  la  aaaantial  to  accomplish  unit  mission. 

Plan  inoludaa  tha  prioritization  and  sequencing  of  taaka  aa  wall 
aa  tha  idantification  of  raaouroa  naada  and  supply  aourcaa. 

Far  Balov  Somewhat  Balov  Exceeds 


Plana  hava  many 
important  gaps/ 
dafioianoiaa 


Plana  hava  soma 
important  gapa/ 
dafioianoiaa 


Plana  not  only 
daal  with  aaaantiala 
but  oontinganoiaa/ 
tima  for  rahaaraala 


Parfomanoa  Indioatora 


Laadara  axplioitly  atata/idantify  kay  taaka,  priorities, 
aaquancing,  raaouroaa. 


Subordinataa  know  kay  aapacta  of  plana. 


Plana  includa  alaap  plana,  tima  for  rahaaraala,  waya  to  daal 
with  oontinganoiaa. 


CQMBQKBH1JB:  Plan  TlniliniSl 

Standard: 


Plana  ara  providad  in  a  timaly  faahion  to  aubordinataa. 

(Tha  1/3  -  2/3  rula  ia  a  guidalina  only) 

Initial  planning  ia  dona  to  produoa  warning  ordara. 

With  tima  conatrainta,  laadara  prioritiza  planning  faotora. 


Par  Balow 


Somewhat  Balow  Exceeds 


Evan  with  anough 
tima  for  own 
planning,  laadara 
laava  little  tima 
to  aubordinataa 


Laadara  laava 

aoma  tima  for 
aubordinataa 
to  plan;  but  not 
anough 


Laadara  produoa 
quality  plana  vary 
quickly.  Subordinataa 
hava  tima  to  davalop/ 
rahaaraa  own  plana. 


Parformanoa  Indioatora 


Warning  ordara  with  kay  plan  aotiona  ara  providad  aubordinataa. 
Subordinataa  hava  anough  time  for  planning. 

Laadara  adjuat  planning  approach  to  time  conatrainta. 
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SUPERVISION 


COMPONENT  A:  Specifying  Task*  and  Standards 

Standard: 

Laadars  apaoify  critical  tasks/standards  for  aubordinataa  in  a 
timely  fashion  through  orders,  instructions,  SOPs,  and  othar 
naans  such  that  subordinates  know  what  thay  hava  to  do. 

Par  Balov  Somewhat  Balov  Exceeds 

Laadars  consistently  Laadars  fail  at  Laadars  specify  tasks 

fail  to  specify  times  to  specify  so  that  subs, 

important  tasks  important  tasks  can  deal  with  on 

follow-up  tasks/ 
contingencies 


Performance  Indicators 
Laadars  explicitly  state  tasks/standards 
Unit  uses  SOPs  affectively  to  specify  tasks/standards 
Subordinatas  know  tasks/standards. 


COMPONENT  B:  leaders  Check  and  Enforce  Standards 

Standard: 


Leaders  consistently  check  whether  tasks  hava  been  dona  to 
specif ications,  hava  daficiancias  corrected,  follow  up  on 
corrections.  Leaders  combine  personal  inspections  and  use  of 
the  chain  of  command. 


Far  Below  Somewhat  Below  Exceeds 


Important  Leaders 

tasks  are  check  on 

often  not  important  tasks 

checked/corrected  only  somstimes 


Mistakes  are 
identified/corrected 
before  they  have 
an  adverse  impact 


Performance  indicators 


Leaders  checks  on  tasks  and  takes  actions  to  enforce 
standards. 

Subordinates  make  corrections. 

Subordinates  report  that  leaders  monitor  performance, 
care  about  doing  things  right. 


COMMUNICATION 


CQMPONBfLAl 


Standard: 


Inform, subordinate 


Communication  with  aubordinatea  ia  clear,  conciaa,  timaly  and 
oomplata.  Laadara  convay  tha  intant  of  any  ordara  or 
inatructiona  and  tha  prioritiaa. 

Subordinataa  undaratand  tha  ovarall  unit  mlaaion  two  lavala  up.* 
Laadara  chack  to  anaura  that  aubordinataa  undaratand. 


Far  Balov  Somavhat  Balov  Exceada 


Communicationa  Soma  coamunioationa 

ara  poorly  dona  dona  wall  but  aoma 

and  too  infraquant  kay  information 

not  paaaad  on 


Communicationa  vary 
affaotiva  and  timaly. 
Lovaat  laval  aoldiar 
haa  a  high  inaight 
into  miaaion 


Farformanoa  Indioatora 

OPORDERS,  Warning  Ordara  ara  clear,  amphaaisa  prioritiaa/ intant. 


Laadara  aak  for  briafbacka  and  anaura  aubordinata  undaratanding . 


Subordinataa  can  accurately  daacriba  miaaion  intant  and  kay  info. 


•v'JvIV'KHCY 


r.  at ... 


Standard: 


Caanmnloatlng  ¥lth,guparlora 


Laadara  uaa  claar,  conciaa,  compata  timaly  communicationa  to  kaap 
aupariora  informed  of  naadad  information  in  tha  araaa  of  miaaion 
planning,  preparation,  and  execution.  Tha  laadara  aak  quaationa 
of  aupariora  to  anaura  their  undaratanding  of  their  aupariora' 
ordara  and  information. 


Far  Balov 

Communicationa 
infraquant 
and  not  dona 
wall 


Somavhat  Balov  Excaada 


Soma  communicationa 
dona  affectively 
but  aoma  kay 
Information  not 
provided 


Excellent  at 
anticipating 
information  naadad 
by  aupariora 


Performance  Indioatora 


Superlore  provided  with  important  information,  updating  atatua. 


Laadara  aak  quaationa  of  aupariora  to  anaura  undaratanding. 


Laadara  communicationa  ara  claar,  conciaa,  complete  and  timaly, 
given  tha  circumatanoaa. 
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INITIATIVE 

COMPONENT  A:  Initiate  AstlQM  to  ASSflBPliffh  ILLlliflD 
Standard! 

Laadara  oonaiatantly  taka  aotiona  to  accomplish  nisaion  without 
waiting  for  ordara  to  do  aot  Exploit  battlefield 
opportunitiaa.  Suggest  ohangaa  in  niaaion  plana,  preparation  or 
axaoution  to  superiors. 


Far  Balow 

Takaa  almost 
no  action  on 
own  to  further 
niaaion  auocaaa 


Somewhat  Balov 

Takaa  aona  aotiona 
on  own  to  acconpliah 
niaaion  auocaaa 


Exceeds 

Takaa  every  opportunity 
to  aot  to  further 
niaaion  auocaaa 


Farfomanoe  Indicators 


Laadara  taka  aotiona  without  direct  ordara/suparviaion  to 
solve  problems,  improve  the  chances  for  nisaion  auocaaa. 


Leaders  suggest  to  superiors  changes  in  niaaion 
plana/ execution. 


Leaders  contact  aupariora  about  important  information  that 
they  discover. 

Leaders  contact  superiors  and  others  to  point  out  things 
that  need  to  be  corrected  such  aa  shortages  of  ammunition. 
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SOLDIER/TEAM  DEVELOPMENT 


CPMEOHSHT  At  BnCPUrttgO  .I»Mtt03CE 

gtandflgfli 


Leaders  consistently  taka  actions  to  incraaaa  and  Maintain  the 
activation  of  platoon  members  to  work  aa  a  tean  to  meet  Bias ion 
objactivoa. 

Ear  Balov  Boaevhat  Balov  Exceeds 


Laadara  taka 
vary  faw 

affactiva  actions 
to  inprova 
taaavork 


Laadara  taka  aoaa 
affactiva  actions 
to  inprova  teamwork 
but  Bias  aoaa 
good  chancaa 


Conaiatantly  taka 
aany  actions  to 
inprova  teamwork; 
aoaa  craativa 
approaches  uaad 


Performance  Indicators 


Laadara  coach  on  how  platoon  nanbara  can  battar  work  togathar. 
Loaders  uaa  positive  feedback  to  encourage  subordinates. 

Leaders  share  hardships.  Leaders  willing  to  push  tired  soldiers. 


LSI 


Xttkg-Cart.  or  6Q.ldiarB...Pl)YBl.gal  Heidi 


Standard: 


Troops'  needs  are  net,  as  conditions  allow,  in  terns  of  food, 
water,  sleep,  safety,  and  nedical. 

Far  Below  Somewhat  Belov  Exceeds 


Troops'  needs 
often  not 
net  even  whan 
it  could  be 
done  easily 


Troops'  needs 
sonatinas  net 
but  not  aj 
often  as  could 
have  been 


Leaders  taka  care 
of  needs  even 
under  difficult 
circumstances 


Perforaanca  Indicators 

Troops  get  needed  food  and  water;  sleep  plans  set  up/ followed. 
Leaders  connunicate  and  nonitor  safe  practices. 

Leaders  check  on  well  being  of  troops. 

Leaders  make  efforts  to  nake  sure  needed  supplies  are  available 
for  troops. 
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APPENDIX  C 

THIRD  OBSERVER/CONTROLLER  CARD 


C-l 


Third  Card  Used  in  First:  Rotation 


C-2 


T-ont  fupper  half ^  and  Back  flower  half)  of 
Used  in  Second  and  Third  Rotation 


APPENDIX  D 

OUTLINE  OF  SUBJECT-MATTER-EXPERT  (SME) 
OBSERVATION  GUIDE 


D-l 


SMS  OBSERVATION  GUIDE 
LEADERSHIP  FOCUSED  ROTATION 

NTC  Rotation  88-5 


SME 


SME _ 

OC  Team _ 

TF/ CO/ PI a toon _ 

Mieeion _ 

PLANNING-PREPARATION 

Date/Time  Platoon  received  warning  order 


Date/Time  Platoon  received  operations  order  from  Company 


Issuance  of  company  operations  order  was  attended  by: 

_  SME  _  PL 

_  OC  PSG 

Company  operations  order  was  suoh  that  it: 

Described  the  BN  CDR's  intent? 

_  Yes 

_  No 

Described  the  Platoon's  role  in  fulfilling  the  BN  and  CO 
CDRs '  intentions? 

_  Yes 

_  No 

The  Platoon  received  (select  one) 

_  Goals/Objectives  to  be  obtained? 

^ _  Procedures/Operations  to  be  executed? 

Issuance  of  the  platoon  operations  order  was  attended  by: 

_  SME  PL 

OC  PSG 
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Was  Platoon  Leader  (PL)  or  the  Platoon  Sergeant  (PSG)  killed  or 
wounded  during  this  mission?  If  so,  reoord  for  eaoh  instance  the 
date/time  that  the  PL  or  PSG  was  killed/wounded  and,  if  this 
occurs,  the  subsequent  date/time  that  the  PL  or  PSG  was  brought 
back  into  play. 

PL  killed/wounded  at 

brought  back  at 

PL  killed/wounded  at 

brought  back  at 

PL  killed/wounded  at 

brought  back  at 

Note:  Write  in  additional 

times  if  necessary. 

PSG  killed/wounded  at 

brought  back  at 

PSG  killed/wounded  at 

brought  back  at 

PSG  killed/woundad  at 

brought  back  at 

Note:  Write  in  additional 

times  if  necessary. 

Record  the  dates  and  times  when  the  Platoon  Leader  (PL)  and 

Platoon  Sergeant  (PSG)  are  known  to  have  been  asleep  on  a 
periodic  basis.  Also  record  the  dates/times  when  they  were 
obviously  awake. 

PL  asloep  at 

awake  at 

PL  asleep  at 

awake  at 

PL  asleep  at 

awake  at 

PL  asleep  at 

awake  at 

PSG  asleep  at 

awake  at 

PSG  asleep  at 

awake  at 

PSG  asleep  at 

awake  at 
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Leader  Performance  by  Competency/ Leader 


For  eaoh  of  the  11  competencies  listed  below  you  will  fill  out  2 
pages  of  information  with  respect  to  the  PL  performance.  You 
will  also  fill  out  the  same  kind  of  information  with  respet  to 
PSG  performance. 


The  first  page  of  information  in  each  case  is  subtitled 
"Performance  Judgement/Key  Incident"  and  the  second  page  is 
subtitled  "Background  to  Performance  Judgment" 


Therefore,  this  section  of  the  observation  guide  is  comprised  of 
44  pages  (2  types  of  information  pages,  times  11  competencies 
times  2  types  of  leaders) 


The  11  competencies  are: 


Planning 

Initiative 

Teach/Counsel 

Flexible 

Communication 


Supervision 

Soldier/Team  Development  Decision  Making 
Motivate  Others 
Technical/Tactical 
Trust  in  subordinates 


NOTE.  Only  the  two  pages  of  the  SME  guide  for  Planning  by  the  PL 
are  presented  in  this  appendix,  the  pages  for  all  competencies 
for  each  of  the  PL  and  PSG  were  identical  to  those  for  PL 
Planning,  except  of  course  for  the  competency  and  the  leader 
rated . 
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PLANNING  BY  THE  PLATOON  LEADER  (PL) 


How  well  did  the  £L  perform  on  this  competency  during  this 
mission?  (Circle  one  of  the  below) 


Performance  vs  Standard 

Far  Below  Somewhat  Meets  Exceeds 

Below  Standards 


If  you  were  able  to  observe  and  judge  the  PL's  performance  on 
this  competency,  indicate  the  following: 

An  incident  during  the  mission  that  was  critical  to  or  that  best 
exemplifies  your  judgment  of  the  PL's  level  of  performance  on 
this  competency:  who  was  involved  in  the  incident,  when  the 
incident  occurred,  important  circumstances,  and  what  the  PL  and 
other  soldiers  involved  did  during  the  incident. 


I 
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PLANNING  BY  THE  PLATOON  LEADER  (PL) 


What  you  did  to  obtain  information  about  the  PL's  performance  on 
this  competency . 


Practical  considerations  for  an  observer  and  characteristics 
of/conditions  during  the  exercise  important  for  obtaining  good 
information  about  the  PL's  performance  on  this  competency. 


Your  confidence  in  your  judgment  of  the  level  of  the  PL's 
performance  on  this  competency. 


Reasons  for  your  judgment  of  the  PL's  level  of  performance  on 
this  competency. 


If  you  not.  Able  to,.lMd.qg  ,.t.hg  -EL'B  level  g.f..p.ar.fgrmang.a  .on  this. 
fiomBa.tency«  circle  each  of  the  foUgw.lng.bfiIay--th.flt-apBl.ieB  and 
explain. 


1.  My  location  during  the  mission  did  not  allow  me  to 
obtain  critical  information. 

Explanation— 


2.  There  were  equipment  problems. 
Explanation— 


3.  Events  critical  to  (or  performances  exemplifying)  the 
competency  by  the  PL  did  not  occur  during  the  mission. 
Explanation - 
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How  critical  was  the  leadership  effectiveness  of  the  Platoon 
Leader  for  the  platoon's  level  of  success  in  this  mission?  On 
which  of  the  leadership  competencies — planning,  communication, 
supervision,  initiative,  soldier/team  development,  decision 
making,  teaching/counseling,  technical/tactical,  motivating 
others,  and  flexibility — was  the  Platoon  Leader's  leadership  most 
critical? 


How  critical  was  the  leadership  effectiveness  of  the  Platoon 
Sergeant  for  the  platoon's  level  of  success  in  this  mission?  On 
which  of  the  leadership  competencies— -planning,  communication, 
supervision,  initiative,  soldier/team  development,  decision 
making,  teaching/counseling,  technical/taotical,  motivating 
others,  and  flexibility— -was  the  Platoon  Sergeant's  leadership 
most  critical? 
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PL  -  PSG  Relationship 


Next  are  some  dimensions  of  the  relationship  between  the  Platoon 
Leader  (PL)  and  Platoon  Sergeant  (PSG) .  For  each,  circle  the 
alternative  that  best  summarizes  your  judgment  of  the  dimension 
during  this  mission. 


EaUonnanga  va -Standard 

The  Platoon  Leader  consulted  with  the  Platoon  Sergeant  in 
planning  and  key  decisions. 

Far  Below  Somewhat  Meets  Exceeds 

Below  Standard 


The  Platoon  Leader  kept  the  Platoon  Sergeant  informed  about 
changes  affecting  tactics  and  supplies. 

Far  Below  Somewhat  Meets  Exceeds 

Below  Standard 


The  Platoon  Sergeant  supported  the  Platoon  Leader  through  sound 
advice  and  coordinating  with  subordinates. 

Far  Below  Somewhat  Meets  Exceeds 

Below  standard 


The  Platoon  Sergeant  took  oare  of  logistics  and  supplies  needed 

for  mission  accomplishment  and  unit  effectiveness. 

Far  Below  Somewhat  Meets  Exceeds 

Below  Standard 


The  Platoon  Leader  and  Platoon  Sergeant  had  dearly  defined 
roles. 

Far  Below  Somewhat  Meets  Exceeds 

Below  Standard 
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During  this  mission,  did  tha  Platoon  Leader  or  Platoon  Sergeant 
either  as  individuals  or  as  a  pair  receive  input  from  an  OC  or 
another  leader  on  aspects  of  their  leadership  performance? 

Yes  _  No  _ 

If  yes,  describe  the  input  given  and,  as  possible,  describe  the 
input  in  terms  of  the  leadership  competencies — planning, 
communication,  supervision,  initiative,  soldier/team  development, 
decision  making,  teaching/counseling,  technical/tactical, 
motivating  others  and  flexibility? 


Was  there  any  important  aspect  of  the  Platoon  Leader's  or  Platoon 
Sergeant's  leadership  during  this  mission  that  has  not  been 
covered  by  your  earlier  comments?  If  so,  please  describe  here. 
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Has  there  evidence  that  a  work/rest  or  sleep  plan  was  in  place 
and/or  being  carried  out?  That  is: 

YES  NO 


Was  it  discussed?  _  _ 

Did  the  Platoon  Leader  and  Platoon 

Sergeant  alternate  sleeping?  _  _ 

Did  Squad  Leaders  (TCs)  get  to  sleep?  _  _ 

Did  soldiers  have  rest  periods?  _  _ 

Were  radio  and  guard  duties  covered 

by  rested  soldiers?  _  _ 

Estimate  the  average  amount  of  sleep  that  the  following  platoon 
members  got  during  the  mission  (from  warning  order  to  after¬ 
action  review) : 

Unit  Member  Average  Hours  of  Sleep 

Platoon  Leader  _ 

Platoon  Sergeant  _ 

Squad  Leaders/Tank  Commanders  _ 

Team/Crew  Members  _ 

Did  everything  come  to  a  halt  in  the  Platoon  when  the  Platoon 
Leader  slept? 

Yes  _  No  _ 

Was  there  ever  a  period  when  all  leaders  in  the  JFlatoon  (Platoon 
Leader,  Platoon  Sergeant,  and  Squad  Leaders  or  TCs)  were  asleep? 

Yes  _  No  _ 
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APPENDIX  E 

SUPPORTING  DATA  TABLES 
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Table  E-l 

Importance  of  Leadership  to  Platoon  Mission  Accomplishment 


Mean 

Standard 

Number  of 

Importance  of 

Rating 

Peviation 

Platens 

PL  Leadership 

2.9 

.7 

59 

PSG  Leadership 

2.8 

.7 

55 

Note.  Ratings  from  second  and  third  rotations.  Results 
consistent  with  ratings  for  the  importance  of  leadership  as  a 
whole  from  the  first  NTC  rotation. 
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HI  HI 


Correlation  with 


Relationship 


Comoonent 

Mean  ... 

SD 

MA-EFF 

SUM-EFF 

PL  consulted 

2.4 

.60 

.63 

.50 

with  PSG 

(24) 

(21) 

(22) 

PL  informed  PSG 

2.7 

.44 

.47 

.44 

about  changes 

(24) 

(21) 

(22) 

PSG  supported 

2.7 

.57 

.37 

.44 

PL 

(23) 

(20) 

(22) 

PSG  took  care  of 

2.7 

.49 

.37 

.50 

logistics 

(24) 

(21) 

(22) 

PL  &  PSG  had 

2.6 

.49 

.56 

.54 

clear  roles 

(24) 

(21) 

(22) 

Note.  Entries  are  MA  levels  of  performance  (means  and  standard 
deviations)  and  correlations  of  the  MA  judgments  with  MA-EFF  and 
with  SUM-EFF.  Sample  sizes  are  in  parentheses.  Correlations  of 
.44  or  greater  are  statistically  significant,  p  <  .05. 
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